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DEFINITIONS 

IDA  publishes  the  follosring  documents  to  raport  the  nsults  of  its  urotfc. 


Reports 


Reports  are  the  most  authoritative  and  most  carelully  considered  products  IDA  puhlishes. 
They  normally  embody  results  of  major  projects  which  (a)  have  a  direct  bearing  on 
decisions  affecting  major  programs,  (b)  address  issues  of  significant  concern  to  the 
Executive  Branch,  the  Congress  and/or  the  public,  or  (c)  address  issues  that  have 
significant  economic  implications.  IDA  Reports  are  reviewed  hy  outside  panels  of  experts 
to  ensure  their  high  quality  and  ralevanca  to  the  problems  studied,  and  they  are  released 
by  the  President  of  IDA. 

Group  Reports 


Group  Reports  record  the  findings  and  results  of  IDA  established  working  groups  and 
panels  composed  of  senior  individuals  addressing  major  issues  which  otherwlM  would  be 
the  subject  of  an  IDA  Report.  IDA  Group  Reports  are  reviewed  by  the  senior  individuals 
responsihle  lor  the  project  and  others  as  selected  by  IDA  to  ensure  their  high  quality  and 
relevanee  to  the  problems  studied,  and  are  released  by  the  President  of  IDA. 

Papers 

Papers,  also  authorflathra  and  careiully  considered  products  oi  IDA,  address  studies  that 
an  narrower  in  scope  than  those  covered  in  Reports.  IDA  Papers  are  reviewed  to  ensure 
that  they  meat  the  high  standanls  expected  of  retareed  papers  In  proteuional  journals  or 
formal  Agency  reports. 

Documents 

IDA  Documents  are  used  fur  ttia  convenience  of  the  sponsors  or  the  analysis  (a)  to  record 
suhstanllve  work  done  in  quick  reaction  studies,  (b)  to  record  Uw  proceedings  of 
conferences  and  meetings,  (c)  to  make  available  preliminary  and  tentative  results  ut 
analyses,  (d)  to  tecord  data  developed  In  the  course  of  an  investigation,  or  (e)  to  forward 
information  that  is  essandally  unanalyad  and  unevaluated.  The  review  of  IDA  Docamenls 
is  suited  to  their  content  and  intended  use. 
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endorsement  hy  Ore  Department  of  Dolsnss,  nor  should  the  contents  be  construed  as 
reflecting  ttie  elHcial  position  of  ttiat  Agency. 
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ABSTRACT 


This  report  discusses  the  amount  and  kinds  of  DoD  interactive  courseware  (ICW) 
programs  that  are  candidates  for  transfer  to  the  i»ivate  sector.  The  Defense  Instructional 
Technology  Information  System  (DITIS)  was  analyzed  to  identify  ICW  programs  that  ate 
candidates  for  transfer  fiom  the  DoD  to  the  private  sector.  Out  of  4644  ICW  programs  that 
have  been  reported  to  DmS  since  its  inception  in  May  1991,  2718  were  identified  as 
having  possible  utility  in  meeting  private  sector  training  requirements.  Of  these  2718 
programs,  591  were  computer-based  instruction  programs  that  run  on  the  MS-DOS 
operating  system,  1997  were  computer-based  instruction  programs  that  run  on  the  NOS 
operating  system  and  were  prepared  using  the  TUTOR  authoring  system,  and  130  were 
interactive  videodisc  programs  that  run  on  the  MS-DOS  operating  system.  Final 
determination  of  the  transferability  of  these  programs  will  depend  on  mme  authoritative 
suitability,  legal,  and  security  reviews  that  must  be  undertaken  on  a  case-by-case  basis. 
The  DoD  has  taken  several  initiatives  to  assist  the  private  sector  in  transferring  DoD  ICW 
programs  to  the  civilian  workforce  for  training.  However,  a  number  of  issues,  particularly 
those  involving  the  availability  of  resources  and  the  establishment  of  respcmsibilities,  must 
be  resolved  before  a  cmnprehensive  set  of  procedures  for  transfer  can  be  successfully 
implemented. 
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SUMMARY 


I.  BACKGROUND 

This  report  is  the  second  prepared  in  response  to  Congressional  interest  in 
transferring  DoD  instructional  materials  to  the  private  sector  for  workforce  training.  The 
first  report  suggested  DoD  policy  and  procedures  for  instructional  materials  transfer.  This 
report  discusses  the  amount  and  kinds  of  DoD  interactive  courseware  programs  that  are 
candidates  for  transfer  to  the  private  sector.  In  accordance  with  the  Training  Technology 
Transfer  Act  of  1988,  the  emphasis  in  this  report  is  on  the  transfer  of  interactive 
courseware  (ICW). 

II.  PRIVATE  SECTOR  REQUIREMENTS 

The  private  sector  is  emphasizing  greater  worker  responsibility  and  participation  at 
all  levels  of  the  workforce,  thereby  increasing  requirements  for  improved  worker  skills, 
higher  standards  of  performance,  and  more  training.  A  number  of  studies  have 
documented  the  need  for  American  workforce  training  in  five  categories  of  competencies 
that  private  sector  managers  seek  in  entry-level  personnel.  These  categories  are: 
(1)  Personal  Characteristics  and  Attitudes,  (2)  Interpersonal  and  Teamwork  Skills, 
(3)  Higher  Order  Thinking  Skills,  (4)  Basic  Skills,  and  (5)  Job-Specific  Technical  Skills. 
If  DoD  ICW  programs  that  address  these  competencies  can  be  transferred  to  the  private 
sector,  they  may  provide  needed  workforce  training. 

III.  DoD  INITIATIVES 

In  accord  with  the  Training  Technology  Transfer  Act  of  1988,  the  DoD  has  taken  a 
number  of  initiatives  to  increase  the  availability  and  transferability  of  its  ICW  programs. 
These  initiatives  include  (1)  issuance  of  MIL-STD-1379D  to  ensure  the  portability  of 
ICW  programs  across  many  delivery  platforms;  (2)  issuance  of  DoD  Instruction  1322.20 
and  establidiment  of  the  Defense  Instructional  Technology  Information  System  (DmS) 
to  improve  the  development,  management,  and  reporting  of  ICW  programs;  and 
(3)  develt^ment  of  procedures  for  transferring  ICW  programs  to  the  private  sector. 
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Procedures  for  transferring  ICW  programs  that  are  audiovisual  productions,  such  as 
interactive  videodisc  programs,  are  already  specified,  and  similar  procedures  are  being 
developed  for  transferring  ICW  programs  that  are  not  audiovisual  productions,  such  as 
computer-based  instruction  programs. 

IV.  TRANSFERABLE  DoD  COURSEWARE 

The  DmS  database  was  analyzed  to  identify  ICW  programs  that  are  candidates  for 
transfer  from  the  DoD  to  the  private  sector,  although  final  determination  of  transferability 
will  depend  upon  the  results  of  more  authoritative  suitability,  legal,  and  security  reviews 
that  must  be  undertaken  on  a  case-by-case  basis.  Out  of  4644  ICW  programs  that  have 
been  reported  to  DITIS  since  its  inception  in  May  1991,  2718  were  identified  as  having 
possible  utility  in  meeting  private  sector  training  requirements.  Of  these  2718  programs, 
59 1  were  computer-based  instmction  programs  that  run  on  the  MS-DOS  operating  system, 
1997  were  computer-based  instruction  programs  that  run  on  the  NOS  operating  system  and 
were  prepared  using  the  TUTOR  authoring  system,  and  130  were  interactive  videodisc 
programs  that  run  on  the  MS-DOS  operating  system. 

V.  CONCLUSIONS 

The  following  conclusions  may  be  drawn  fnnn  this  review: 

•  A  number  of  DoD  ICW  programs  appear  to  be  candidates  for  transfer  to  the 
private  sector,  but  final  judgements  on  their  transferability  require  more 
authoritative  and  conqirehensive  reviews  that  must  be  performed  on  a  case-by¬ 
case  basis.  Many  of  these  ICW  programs  have  proved  to  be  of  significant 
value  in  DoD  training  and  may  be  useful  in  meeting  private  sector  workforce 
training  requirements  if  diey  can  be  transferred. 

•  Workable  procedures  are  already  in  place  to  aid  in  the  transfer  of  DoD  ICW 
programs  that  are  audiovisual  productions,  such  as  interactive  videodisc 
programs.  These  procedures  serve  as  a  model  for  effecting  transfer  of  other 
ICW  programs  that  are  not  audiovisual  productions,  such  as  computer-based 
instruction  programs. 

•  The  problems  of  resourcing  and  responsibilities  remain.  Through  its  policies 
and  procedures,  the  DoD  is  prepared  to  assist  the  private  sectOT  in  making  DoD 
ICW  programs  available  for  transfer,  but  resources  both  within  the  DoD  and 
outside  the  DoD  remain  to  be  idoitified  and  responsibilities  for  many  necessary 
functions,  especially  those  to  be  performed  outside  the  DoD,  remain  to  be 
assigned. 
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I.  BACKGROUND 


This  report  is  the  second  prepared  in  response  to  Congressional  interest  in 
transferring  DoD  instructional  materials  to  the  private  sector  for  worlforce 
training.  The  first  report  suggested  DoD  policy  and  procedures  for 
instructional  materials  transfer.  This  report  discusses  the  amount  and  lands 
of  DoD  interactive  courseware  programs  that  are  candidates  for  tranter  to 
the  private  sector.  In  accordance  with  the  Training  Technology  Tranter  Act 
of  1988,  the  en^>hasis  in  this  report  is  on  t^  transfer  of  interactive 
courseware  (ICW). 

The  National  Defense  Authorization  Act  for  Fiscal  Years  1992  and  1993  directed 
the  Department  of  Defense  "to  prepare  an  inventory  on  DoD  training  and  education 
programs  that  relate  to  workforce  training  issues  of  concern  to  the  private  sector."  This 
report  was  prepared  in  response  to  that  direction.  An  earlier  report  (Fletcher,  Bosco, 
Wienclaw,  Ashcraft,  and  Boycan,  1991)  was  also  produced  in  response  to  Congressional 
interest  in  this  topic.  It  discussed  policies  and  procedures  that  might  be  used  to  effect  the 
transfer  of  DoD  instructional  materials  to  the  private  sector.  In  accordance  with  the 
Congressional  direction,  this  second  report  discusses  what  and  how  many  DoD  interactive 
courseware  (ICW)  programs  might  be  candidates  for  transfer  to  the  private  sector. 

Interest  in  the  DoD  as  a  source  of  instructional  materials  for  the  private  sector  has 
been  growing  for  several  years.  A  number  of  Congressional  actions  have  been  taken  to 
facilitate  and  govern  transfer  of  DoD  materials  and  technologies  to  non-DoD  implications. 
Three  of  these  initiatives  are  the  following: 

•  The  Stevenson-Wydler  Technology  Innovation  Act  of  1980.  This  act  focuses 
on  research  and  development.  It  authorizes  the  establishment  of  Centers  for 
Industrial  Technology  and  is  intended  to  stimulate  use  of  federally  funded 
research  and  development  products  by  state  and  local  governments  and  the 
private  seaor.  In  the  case  of  instructimi,  the  act  facilitates  and  encourages 
transfer  of  research  and  development  products  from  the  DoD  personnel 
research  laboratories  to  non-DoD  applications. 

•  The  Federal  Technology  Tranter  Act  of  1986.  This  act  also  focuses  <mi 
research  and  development.  It  amends  the  Stevenson-Wydler  Act  by 
authorizing  cocmerative  research  and  develoimient  agreements  between  Federal 
and  non-Federal  laboratories  and  by  establishing  a  Federal  Laboratory 
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Consortium  for  Technology  Transfer  within  the  National  Institute  for 
Standards  and  Technology. 

•  The  Training  Technology  Tranter  Act  of 1988.  This  act,  which  is  a  chapter  of 
the  Omnibus  Trade  and  Competidveness  Act  of  1988,  focuses  on  the  transfer 
of  federally-developed  education  and  training  software  to  non-Federal 
activities.  The  act  is  intended  to  facilitate  transfer  of  education  and  training 
software  from  Federal  agencies  to  applications  that  support  the  education, 
training,  and  retraining  of  industrial  workers,  especially  workers  in  small 
business  concerns.  It  specifically  identifies  the  DoD  as  a  potential  source  of 
instructional  software.  The  act  establishes  an  Office  of  Training  Technology 
Transfer,  which  is  to  maintain  a  clearinghouse  of  information  on  federally 
developed  education  and  training  software. 

Given  the  scope  of  this  topic  and  the  level  of  interest  in  it,  other  Congressional 
initiatives,  some  of  which  are  now  under  discussion,  are  likely  to  affect  requirements  and 
responsibilities  for  transferring  DoD  instructional  materials  to  the  private  sector. 

The  DoD  has  responded  to  these  initiatives  with  several  actions  of  its  own.  Many 
of  these  actions,  including  the  development  of  the  policies  and  procedures  outlined  earlier 
(Fletcher  et  al.,  1991),  were  undertaken  jointly  and  cooperatively  by  the  OASD(FM&P) 
Readiness  and  Training  Directorate  and  the  OASD(PA)  Defense  Audiovisual  Policy  Office. 
These  actions  emphasize  development,  management,  and  transfer  of  the  instructional 
software  that  is  the  primary  concern  of  the  Training  Technology  Transfer  Act 

The  DoD  describes  this  software  as  "Interactive  Courseware"  (ICW),  which  is  used 
as  a  general  term  for  all  varieties  of  interactive,  instructional  software.  KTW  is  defined  as 
computer-controlled  instructional  material,  or  courseware,  that  relies  on  student  input  to 
determine  the  pace,  sequence,  and  content  of  instruction  delivery.  Courseware  by  itself 
refers  to  all  training  materials,  including  the  curriculum  database  and  all  disks,  tapes, 
books,  charts,  and  computer  programs,  necessary  to  deliver  an  ICW  program. 

The  key  distinction  between  an  ICW  program  and  other  training  programs  is  the 
provision,  through  use  of  computer  technology,  of  interactions  that  tailor  the  instruction  to 
the  needs  of  individual  students.  With  individually  tailored  instruction,  ea  student 
receives  the  level  of  detail,  pace,  remediation,  sequence  of  topics,  and  interactions  needed 
to  learn  the  material  efficiently  within  the  limits  imposed  by  time  and  access  to  other 
instructional  resources.  ICW  programs  can  individualize  instruction  within  currently 
established,  group-oriented  instructional  institutions.  This  advantage,  combined  with  the 
fact  that  ICW  programs  tend  to  be  developed  as  transportable,  or  autonomous,  noodules  of 
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instruction,  makes  them  promising  candidates  for  smooth  transfer  to  training  in  the  private 
sector. 

Transfer  of  DoD  education  and  training  materials  and  technologies  is  motivated  by 
the  workforce  requirements  of  the  private  sector.  These  requirements  are  briefly  reviewed 
in  Section  II.  Section  III  describes  initiatives  taken  by  the  DoD  to  improve  its  own 
management  of  ICW  programs.  These  initiatives  also  facilitate  access  and  transfer  of  DoD 
ICW  programs  to  outside  agencies  and  the  private  sector.  Section  IV  provides  an 
assessment  of  the  amount  and  kinds  of  DoD  ICW  programs  that  might  be  made  available  to 
meet  workforce  training  requirements  in  the  private  sector.  Section  V  presents  a  few 
conclusions  that  might  be  drawn  based  on  these  findings. 


II.  PRIVATE  SECTOR  REQUIREMENTS 


The  private  sector  is  emphasizing  greater  worker  responsibility  and 
participation  at  all  levels  of  the  worlforce,  thereby  increasing  requirements 
for  improved  worker  skills,  higher  stan^rds  of  performance,  and  more 
training.  A  number  of  studies  have  documented  the  need  for  American 
workforce  training  in  five  categories  of  competencies  that  private  sector 
managers  seek  in  entry-level  personnel.  These  categories  are:  (1)  Personal 
Characteristics  and  Attitudes,  (2)  Interpersonal  and  Teamwork  Skills, 

(3)  Higher  Order  Thinking  Skills,  (4)  Basic  Skills,  and  (5)  Job-Specific 
Technical  Skills.  IfDoD  ICW  programs  that  address  these  competencies 
can  be  tranrferred  to  the  private  sector,  they  may  provide  needed  worlforce 
training. 

What  instructional  programs  are  of  interest  to  the  private  sector?  This  question  is 
best  addressed  by  considering  the  workforce  competencies  that  are  of  most  concern  to 
managers  in  the  private  sector.  Several  studies  have  been  completed  recently  that  address 
this  issue.  Seven  of  them  are  listed  and  briefly  described  in  Table  1. 

These  studies  all  note  that  the  challenge  of  competing  in  the  world  market 
necessitates  re-examination  of  our  use  of  people  in  organizations.  The  early  pan  of  this 
century  wimessed  a  burgeoning  concern  about  how  to  organize  the  efforts  of  individuals  in 
the  large  organizations  that  grew  out  of  the  industrial  revolution.  Increasingly,  the  hunum 
factor  was  recognized  as  critical  to  productivity.  Irederick  Taylor,  who  is  considoed  the 
father  ol  American  management,  recognized  diat  limitations  in  the  dolls  of  woricers  limited 
the  productivity  of  their  organizations  (Taylcn-,  1916).  His  answer  to  perceived  deficiencies 
in  worker  skills  was  an  extensive  rrumagerial  structure  to  organize  and  supervise  the 
workers,  leaving  them  with  as  little  individual  responsibility  and  discretion  as  possible. 
This  approach  has  been  subjected  to  increasingly  critical  scrutiny  in  recent  years. 

Today,  managers  recognize  that  weakens  must  assume  more  responsibility  at  points 
of  production,  sales,  or  service  tendered,  if  their  organizatiems  are  to  coaq>ete  successfully 
in  today's  world  markets  (e.g.,  Johnston  and  Packer,  1987;  Senge,  1990;  U.S.  Congress, 
Office  of  Technology  AssessnKnt,  1990;  and  others).  To  introduce  ttew  products  and 
services  quickly  with  high  quality,  managers  are  et!q>hasizing  greater  worker  participation, 
flatter  organizational  structures,  just-in-dme  management  approaches,  job  rotation,  and 


Table  1.  Reports  Documenting  the  Need  for  Job  Skills 


Report 

Trends 

Anterica's  Choice:  High 
Skiiis  or  Low  Wages! 
(National  Center  on 
Education  and  the 
Economy,  1990) 

Higher  worker  skill  requirements 

U.S.  embarking  on  a  "third 
industrial  revolution" 

High  Sr^ools  and  the 
Charting  Workplace 
(National  Academy  of 
Sciences,  1984) 

American  economy  in  a  period  of 
drastic  change 

Workplace  requirements  will 
continue  to  change 

Michigan  Employability 
Skiiis  Employer  Survey 
(Mehrens,  1989) 

Training  and  education  needs  are 
constantly  changing 

Formal  education  will  never  meet 
all  the  needs  of  the  marketplace 

What  Work  Requires  of 
Schools 

(Seaetar/s  Commission 
on  Achieving  Necessary 
Skills,  1991) 

Globalization  and  technotogy 
contain  both  threat  and  promise 

High  performance  workplaces  are 
the  model  for  a  succes^l  future 

Workar  Training: 
Competing  in  the  New 
International  Economy 
(Office  of  Technology 
Assessment, 

U.S.  Congress,  1990) 

Broader  use  of  computer-based 
training 

"Learning  on  demand" 

Inaeased  emphasis  on  training 
technology 

Workforce  2000:  Work 
and  Workers  tor  the 

21st  Century 
(Johnston  and  Packer, 
1987) 

More  training  and  education  for 
skiiis  required  by  today's  workforce 

People  are  the  primary  asset  of 
today's  organizations 

Workplace  Basics:  The 
Essenda!  Skills  Employers 
Want 

(Camevtrie,  Gainer,  and 
Meltzer,  1990) 

Increasing  nurrfber  of  entry-level 
workers  come  from  (po(4)6  that  are 
educationally  deficier« 

Employees  must  be  able  to  quickly 
understand  and  acquire  new  and 
different  skiiis 

Needs 

Public/private  sharing  or 
responsibility  for  training  and 
education 

Comprehensive  employment/ 
training  policy 

Need  for  education  in  both 
core  competencies  and 
specific  skills 


Need  for  training  and 
education  in  both  generic  and 
specific  skills 

Perceived  and  actual  needs 
may  not  be  the  same 

Need  for  broader  skills  and 
training  for  everyone 

Requirement  for  both 
foundation  and  specialty  skills 
training  and  education 

Need  greater  investment  in 
transferable  skills  training 

Need  more  Federal  assistance 

Encourage  use  of  training 
consortia 

Training  to  meet  changing 
occupational  stnjcture 

Need  to  address  education 
and  training  needs  of 
workforce  now 

Need  sound  basic  skills 
training  to  increase  U.S. 
competitive  edge  and 
individuars  quality  of  We 

Functional  context  approach 
to  job  skWs  training 
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team  work.  This  decentralization  requires  mwe  competency  from  all  members  of  the 
workforce,  and  managers  pursuing  these  goals  back  them  up  with  substantial,  ongoing 
training.  The  report  issued  by  the  Congressional  Office  of  Technology  Assessment 
(Worker  Training,  1990)  concludes  that  "American  companies  that  have  adt^ted  this  model 
have  found  that  their  workers  can  achieve  levels  of  productivity  and  quality  equal  to  the 
best  in  the  world”  (p.  3). 

The  possibility  that  the  U.S.  workforce  may  not  be  prepared  to  meet  current 
challenges  has  been  raised  by  many  studies.  Worker  Training  summarizes  the  discussion 
in  a  way  that  is  characteristic  of  many  reports  cm  this  topic: 

The  quality  of  the  U.S.  workforce  matters  now  more  than  ever.  Well- 
train^,  motivated  workers  who  can  produce  high-quality  goods  and 
services  at  low  cost  help  enhance  industrial  productivity  and 
competitiveness  and  keep  American  living  standards  high.  In  today's 
intematiomd  eoxiomy,  wt^ers  must  be  prqnred  to  change  tiie  way  they  do 
their  jobs  in  order  to  aq)ture  the  benefits  from  nqiidly  evolving  technology. 
Training  goes  hand-in-hand  with  productivity,  quality,  flexibility,  and 
automation  in  the  best  performing  firms. 

Good  traitting  pays  off  for  the  individual  worirer  whose  skills  are  upgraded, 
for  the  conipany  seeking  a  competitive  edge,  and  for  the  Nation  in  ovorall 
productivity  and  competitiveness.  Conversely,  inadequate  training  costs 
firms  and  workers  in  down-time,  defective  p^  or  equipment,  wasted 
rruiterial,  health  and  safety  risks,  late  deliveries,  and  poor  customer  service. 

Poor  training  also  can  delay  the  itrqrletnentaticHi  of  new  technology  or  work 
reorganization. 

When  measured  by  international  standards,  naost  American  wcnkers  are  nor 
well  trained.  Many  in  smaller  firms  receive  no  formal  training.  Larger 
firms  i^vide  more  formal  training,  but  most  of  it  is  for  professionids, 
technicians,  managers,  and  executives.  Our  trutjor  foreign  coiiqretitors  place 
much  greater  emphasis  on  developing  workforce  skills  at  gU  levels. 
Experienced  production  workers  at  Japanese  auto  assembly  plants,  for 
example,  get  three  times  as  much  training  each  year  as  their  American 
counterparts.  (Worker Training,^.  1) 

In  another  analysis,  Camevale  and  Gaino'  (1989)  discussed  the  declining 
percentage  of  U.S.  (jtoss  National  Product  (GNP)  tiiat  is  accounted  for  by  resources  from 
the  earth  such  as  rrunerals,  energy,  and  food.  In  1890,  these  resources  accounted  for 
SO  percent  of  the  GNP.  Today  these  resources  account  for  10  percent  of  the  GNP.  Their 
place  has  been  taken  human  resources  which  now  account  for  more  than  four-fifths  of 
the  nation's  economic  output  Bishc^  (1989)  analyzed  the  impact  of  traitting  on  the 
productivity  of  hunuui  resources  and  found  that  woricers  who  receive  formal  job  traitting 


have  a  30  percent  higher  productivity  level  than  workers  who  are  not  formally  trained. 
Investments  in  training  may  therefore  substantially  improve  economic  productivity. 

The  requirement  for  workers  with  greater  skills  and  capacities  for  responsibility  has 
spawned  many  commissions,  task  forces,  and  studies,  including  those  listed  in  Table  1. 
These  studies  have  contributed  to  the  growing  evidence  that  high  levels  of  workforce 
performance  are  essential  for  successful  competition  in  today's  markets  and  that  woricforce 
training  is  needed  to  achieve  them. 

O'Neil,  Allred,  and  Baker  (1992),  who  reviewed  most  of  the  studies  in  Table  1, 
point  out  that  these  studies  have  begun  in  the  same  way.  Educators,  business  leaders, 
scholars,  and  policy  makers  were  assembled  to  identify  skills  necessary  for  the  workforce. 
These  authorities  generated  a  list  of  necessary  skills  based  on  their  own  knowledge  and 
experience  and  on  independent  investigations  of  the  workforce  and  its  requirements. 
Nearly  all  the  studies  included  a  validation  phase  in  which  employers  and/or  employees 
were  asked  to  rate  the  relative  necessity,  desirability,  or  inqxxrtance  of  each  identified  sldU. 
Although  different  labels  were  used  in  the  studies,  there  is  consistent  agreement  across  all 
the  studies  on  five  major  categories  of  competencies  that  are  sou^t  and  needed  by  workers 
if  their  organizations  are  to  axnpete  successfully  in  the  modem  world.  These  categtnies  of 
competencies  are; 

•  Personal  Characteristics  and  Attitudes.  Important  themes  in  this  category  of 
competencies  are  dependability,  honesty,  motivation,  and  responsibility. 
Many  of  the  private-sector  authorities  rated  workfoix^  qualities  in  this  category 
as  the  most  inqxntant  of  all. 

•  Interpersonal  and  Teamwork  Skills.  Many  of  the  studies  noted  that  as 
responsibility  is  pushed  further  down  die  management  hierarchy,  responsibility 
for  communication  and  cooperation  is  increasingly  shared  by  all  members  of  an 
organization.  Increasingly,  workers  must  communicate,  negotiate,  tolerate  and 
pertuqis  capitalize  on  diversity,  share  leadership,  and  interact  with  others  in  a 
professionally  and  socially  apprc^ate  manner. 

•  Higher  Order  Thinking  Skills.  Each  of  the  studies  identified  die  need  for  skills 
in  this  category  of  competencies.  These  skills  were  judged  necessary  because 
of  the  rapidity  of  change  in  the  workforce  and  its  high  mobility.  The  higher 
order  thinking  skills  most  commonly  identified  were  skills  in  adapting  to 
changes.  These  skills  include  reasoning,  problem-solving,  creativity,  decision 
malting,  and  learning  how  to  learn.  The  laner  skill  was  identified  in  tme  study 
as  the  fundamental  skill. 


•  Basic  Academic  Skills.  Each  study  identified  the  need  for  basic  academic 
skills.  These  include  speaking  and  listening  skills  as  well  as  the  three  R's. 
Worker  Training  concluded  that  "many  American  woikerS"20  percent  or  more 
in  some  firms-are  deficient  in  basic  skills”  (p.  10)  and  that  very  few 
ctxnpanies  now  make  much  effort  to  upgrade  their  employees'  basic  education; 
they  are  more  likely  to  test  job  applicants  for  basic  skills  competencies  and  not 
hire  applicants  who  fail. 

•  Job-Specific  Technical  Skills.  Many  studies  noted  the  need  for  job-specific 
technical  skills  in  the  workforce.  These  are  the  many,  diverse  skills  needed  to 
operate  and  maintain  equipment,  control  complex  systems,  and  follow 
technical  procedures.  These  skills  do  not  require  academic  prqraration  so 
much  as  workplace  experience  and  training  tailored  to  the  needs  of  specific 
jobs. 

ICW  programs  have  been  shown  to  contribute  significantly  to  developing 
competencies  in  the  last  four  of  these  categories.  ICW  contributions  to  the  last  three  of 
these  catagories  (Higher  Order  Thinking  Skills,  Basic  Academic  Skills,  and  Job-Specific 
Technical  Skills)  are  generally  acknowledged  and  documented,  Init  it  should  be  noted  that 
computer-based  instruction  and  interactive  multimedia  technologies  such  as  interactive 
videodisc  have  also  been  found  to  contribute  significantly  to  the  development  of 
interpersonal  and  teamwork  competencies  in  ways  that  are  both  less  labor  intensive  and 
tncwe  effective  than  standard  approaches  using  classroom  instruction  and  role  playing  (see 
Blaiwes  and  Weller,  1978;  Schroeder,  Dyer,  Czerny,  Youngling,  and  Gillotti,  1986,  for 
examples).  Whether  or  not  ICW  programs  can  contribute  to  the  development  of 
competencies  in  the  first  category  (Personal  Characteristics  aixi  Attitudes)  has  yet  to  be 
assessed. 

Worker  Training  (1990)  also  emphasized  the  plight  of  small  firms,  those  with  100 
employees  or  less.  These  firms  provide  about  35  percent  of  total  U.S.  employment,  but 
they  lack  the  expertise  to  provide  in-house  training,  the  resources  to  pay  fOT  outside 
training,  and  sufficient  numbers  of  people  who  need  training  at  any  one  time  to  justify  a 
focused  training  effort  Further,  they  are  noore  likely  to  employ  workers  who  have  less 
educatkm  and  are  older  ot  youngo-  than  the  average.  They  usually  try  to  provide  training 
through  unstructured,  informal  approuhes  that  vary  widely  in  quality.  Transportable, 
quality-ccmtrolled  training,  such  as  that  available  from  many  ICW  programs,  may  help 
solve  the  training  laoblems  of  small  firms. 

Larger  firms  are  mcne  likely  to  provide  formal  training  than  smaller  tmes,  but  the 
training  tiiey  provide  is  laigely  limited  to  managers  and  technicians.  The  lower  die  level  of 
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skill  a  weaker  brings  to  a  firm,  the  less  likely  it  is  that  he/she  will  receive  training  from  the 
firm.  Still,  the  amount  that  firms  invest  in  training  their  workers  is  sizable.  Estimates  of 
these  investments  range  from  $33-44  billion  a  year,  with  about  $9  billion  provided  by 
outside  sources.  However,  this  investment,  which  is  0.6-0.9  percent  of  GNP,  may  be  far 
short  of  what  is  needed.  The  American  Society  for  Training  and  Development  (undated) 
estimated  that  in  1989  the  total  cost  to  retrain  those  pans  of  the  American  workforce 
that  required  skill  updates  and  enhancements  would  have  been  $64  billion  of  which 
$45.4  billion  would  have  been  the  employer  share.  The  number  (over  45  million)  and 
percent  (about  42  percent)  of  workers  who  needed  but  did  not  receive  retraining,  and  the 
cost  (over  $45  billion)  of  that  retraining  are  shown  in  Table  2.  ICW  programs  may  lessen 
this  shortfall  through  their  accessibility  and  relative  cost-effectiveness.  A  supply  of  already 
prepared,  available  ICW  programs  could  increase  this  possilnlity. 

Table  2.  Unmat  Naad  for  Retraining  American  Worfcara  In  1989 


Type  of  Retraining 

Number  (and  Percent)  of 
Workers  Who  Needed  but 
Did  Not  Receive  Training 
(CY 1989) 

Money  Needed  for 
Retraining  ($B) 
(Employer  Share) 

New  Technology  Training 

•  Technical  Workers 

9,255,270 

(8%) 

$8.7 

•  SMIled  Workers 

6,815,680 

(8%) 

$6.5 

Executive,  Management,  and 
Supenrisoiy  Training 

5,490,374 

(5%) 

$9.7 

Customer  Service  Training 

11,394,240 

(9%) 

$5.4 

Basic  SMIs  Training 

16,559,243 

(14%) 

$15.1 

Total 

49,514,807 

(42%) 

$45.4 

Over  die  past  two  decades  die  states  have  eiqianded  dieir  investment  in  training  as  a 
way  to  attract  new  firms,  to  encourage  resident  employo^  to  create  new  jobs,  and  to  help 
other  resident  employers  to  improve  their  business  performance.  Worker  Training  showed 
that  in  1989,  44  states  supported  (me  or  more  customized  training  programs.  These 
programs  served  a  variety  of  goals,  but  the  states  reported  an  increasing  donand  for 
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training  to  upgrade  already  employed  workers-for  in-service  training.  Many  of  these 
programs  relied  on  community  colleges  or  vocational-technical  institutes  to  deliver  the 
training.  There  are  numerous  examples  of  community  colleges  providing  customized 
training  for  business,  and  it  is  likely  that  the  states  and  their  community  colleges  could 
benefit  from  the  availability  of  DoD  ICW  oriented  toward  specific  skills. 

The  U.S.  economy  will  continue  to  support  large  numbers  of  low-skilled  jobs  in 
the  future,  but,  according  to  the  Bureau  of  Labor  Statistics  (BLS),  nearly  all  the  new  jobs 
that  will  be  created  over  die  next  10  years  will  be  in  service  industries.  These  new  jobs  will 
be  split  fairly  evenly  between  knowledge-based,  high-skilled  services  (mainly  involving 
health,  business  services,  and  education)  and  traditional,  low-skilled  services  (mainly 
involving  retail  trade  and  personal  services).  Despite  the  rapid  growdi  of  knowledge-based 
jobs,  of  the  10  occupatitms  with  the  greatest  number  of  new  jobs  that  the  BLS  expects  to 
see  created  by  the  year  2000,  only  two  require  post-secondary  school  credentials  for  entry. 
However,  all  these  jobs  require  trairung-especially  upgrade  trairung,  which  is  infrequently 
provided  and  is  mtne  likely  to  be  given  to  wmkers  with  more  rather  than  less  previous 
training  and  educatitm. 

The  proUem  of  noaking  substantial  improvements  in  dte  drill  levels  of  die  American 
workforce  is  complex  and  unlikely  to  be  solved  by  any  one  action.  However,  it  does 
qipear  that  tran^xirtable,  quality-controlled  training  packages  (such  as  those  provided  by 
ICW  programs)  could  help  by  making  training  bodi  more  efficient  and  more  accessiUe. 


III.  DoD  INITIATIVES 


In  accord  with  the  Training  Technology  Transfer  Act  of 1988,  the  DoD  has 
taken  a  number  of  initiatives  to  increase  the  availalMty  and  tran^erability  of 
its  ICW  programs.  These  initiatives  include:  (1)  issuance  of  MIL-STD- 
1379D  to  ensure  the  portability  of  ICW  programs  across  many  delivery 
platforms,  (2)  issuance  of  DoD  Instruction  132220  and  establishment  of 
the  Defense  Instructional  Technology  Information  System  (DITIS)  to 
improve  the  development,  management,  and  reporting  of  ICW  programs, 
and  (3)  development  of  procedures  for  tran^erring  ICW  programs  to  the 
private  sector.  Procedures  for  transferring  ICW  programs  that  are 
audiovisual  productions,  such  as  interactive  videodisc  programs,  are  alreatfy 
specified,  a^  similar  procedures  are  being  developed  for  tran^erring  ICW 
programs  that  are  not  audiovisual  productions,  such  as  computer-based 
instruction  programs. 

llie  courses  presented  by  the  DoD  range  in  length  from  less  than  a  day  to  noore  than 
a  year.  The  format  of  this  instruction  ranges  from  traditional  platform  lecture  using 
texdxx)ks  to  correqxxidence  courses  to  field  exercises  involving  actual  equipment  and  live 
ammunition.  The  instructional  technology  used  also  spans  a  wide  range  and  includes 
lesson  plans,  study  guides,  workbooks,  instructor  guides,  overhead  transparencies, 
textbooks,  workbooks,  programmed  textbooks,  audio  cassettes,  films,  videotapes, 
computer-assisted  instruction,  computer-managed  instruction,  interactive  videodisc 
instructitxi,  CD-ROM  instruction,  part-task  simulators,  two-dimension  simulattvs,  high- 
fidelity  simulators,  laser-simulated  weapons  fire,  netwOTks  of  simulators,  and  actual 
equipment 

Increasingly,  the  DoD  relies  on  interactive  courseware  (ICW)  to  support  its 
instructional  needs.  There  are  several  reasons  for  this: 

(1)  Stability.  The  development  movaUe  ^pe  and  books  provided  a  capability  to 
Cloture  the  content  of  high-quality  instruction  and  deliver  it  inexpensively  to 
many  people.  However,  the  effectiveness  and  efficiency  of  instruction  varies 
if  ctmtent  is  presented  using  different  rules  and  procedures.  In  addition  to 
content,  computer  technology  captures  the  interactions  of  high-quality 
instruction  and  makes  them  widely,  inexpensively,  and  reliably  available  to 
many  peq>le.  ICW  programs  cannot  yet  supply  all  the  interactions  of  an 
individual  tutor  working  with  an  individual  student,  but  they  can  ciqmire  a 
significant  portion  of  it.  What  interactions  diey  do  inovide-along  with  die 


instructional  content-can  then  be  delivered  in  a  stable,  autonomous  fashion  to 
learners,  with  a  minimum  of  the  variability  that  is  characteristic  of  human 
instructors. 

(2)  Effectiveness.  There  have  been  enough  reviews  of  the  effectiveness  of 
computer-based  instruction  that  a  review  of  the  reviews  (Nioniec  and  Walbeig, 
1987)  has  been  published.  It  indicates  an  improvement  of  about  14  percentile 
points  in  student  achievement  through  the  substitution  of  coiiq)uter-based 
instruction  for  more  conventional  approaches.  A  suggestion  of  the 
improvements  to  be  expected  in  the  wider  world  of  ICW  using  interactive 
multimedia  approaches  were  provided  by  Fletcher  (1990),  who  found 
improvements  of  about  19  percentile  points  through  the  use  of  interactive 
videodisc  instruction. 

(3)  Cost-Effectiveness.  One  significant  measure  of  cost  when  students  are  being 
paid  by  die  organization  that  trains  them  is  time  spent  in  training.  A  very  stable 
finding  for  ICW  has  been  that  it  reduces  training  time  by  about  30  percent  over 
more  conventional  means  (Orlansky  and  String,  1979;  Fletcher,  1990).  A 
second  source  of  cost  reductions  through  the  use  of  ICW  invtdves  its  ability  to 
substitute  simulation  for  actual  equipment  without  adversely  affecting  student 
achievement  Use  of  simulations  diat  may  cost  a  tenth  or  even  a  htindredth  of 
the  actual  equipment  used  in  military  systems  has  provided  a  powerful  cost 
incentive  for  using  ICW  programs  to  train  operators  and  maintainers  of  military 
systems. 

Several  actions  to  improve  the  management  and  use  of  ICW  programs  within  the 
DoD  have  been  initiated.  These  actions  include  the  develt^ment  of  policies,  technical 
standards,  and  a  new  automated  reporting  system  and  data  base  that  will  improve  the 
sharing  of  materials  both  within  the  DoD  and  between  the  DoD  and  non-DoD  activities. 
Many  of  these  initiatives  were  undertaken  jointly  and  cooperatively  by  the  OASD(FM&P) 
Readiness  and  Training  DiicctoratB  and  die  OASD(PA)  Defense  Audiovisual  Policy  QfiBce. 
They  center  on  duee  areas:  (a)  ICW  portalnlity;  (b)  development  and  management  of  ICW; 
and(c)  procedures  for  transferring  ICW. 

A.  ICW  PORTABILITY 

Interactive  courseware  (ICW)  portability  refers  to  the  ability  to  qierate  the  same 
software  across  many  different  hardware  platforms.  P(»tability  (1)  reduces  the  costs  and 
increases  die  usainlity  of  both  computers  and  their  software,  (2)  strengthens  die  market  for 
both,  and  (3)  helps  institutionalize  their  use  in  many  diverse  aj^lications. 


Without  portability  for  ICW  programs,  routine  and  widespread  use  of  this 
promising  technology  is  seriously  handicapped.  These  handicaps  include  excessive  cost, 
difficulty  of  use,  technological  inertia,  and  unnecessary  complexity  in  courseware  design, 
development,  delivery,  and  implementation.  These  handicaps  are  removed  by  designing 
interactive  courseware  to  be  portable. 

Interactive  courseware  can  be  pcntable  if  developers  use  standard  practices  to  create 
it  Consequently,  the  topic  of  portability  is  also  a  topic  of  standards-military  standards, 
federal  information  processing  standards,  national  standards,  and  international  standards. 
Implementation  of  these  standards  represents  a  significant  opportunity  and  requirement  for 
cooperation  at  all  levels  of  technical  development  and  across  all  communities  concerned 
with  the  use  of  ICW  programs. 

Portability  means  different  things  to  different  people.  Transportability, 
transferability,  convertibility,  and  related  terms  are  used  to  discuss  the  same  concept  A 
restricted,  but  straightforward  definition  has  been  articulated  as  "the  ability  to  move  an 
ai^lication  from  one  coti^uter  to  another  unchanged  and  get  the  same  results"  (Dahlstrand, 
1984,  p.  17).  The  DoD  definition  is  not  much  different  DoD  Instruction  1322.20  defines 
portalnlity  as  "the  capalnlity  to  run  courseware  and  associated  applicatioi  programs  without 
modification  on  a  delivery  system  other  than  the  cme  for  which  they  were  originally 
designed." 

Courseware  portability  will  increase  the  sharing  of  ICW  within  each  Military 
Service  by  providing  ICW  programs  that  can  be  used  with  little,  if  any,  reprogramming 
across  a  full  range  of  within-Service  instructional  settings  including  initial  skill  training, 
advanced  skill  training,  garrison  training,  job-site  training,  officer  education,  and  Reserve 
eminent  training. 

Courseware  portability  will  also  increase  the  sharing  of  ICW  across  the  different 
Military  Services.  All  the  Services  teach  basic  courses  such  as  electricity,  electnmics, 
hydraulics,  and  motor  vehicle  repair.  It  is  not  unreasonable  to  suggest  that  materials  fev 
these  courses,  or  some  portion  of  them,  be  usable  by  all  the  Services.  This  sharing  is 
neither  an  administrative  nor  political  impossibility.  Joint  training  is  now  offered  in  62 
inter-Service  courses  or  skill  areas  (U.S.  Dept  of  Defense,  Military  Manpower  Training 
Report,  1991),  and  the  need  for  it  will  increase  as  training  budgets  decrease. 

Hnally,  portability  makes  the  transfer  of  ICW  from  die  DoD  to  the  private  sector 
technically  feasible  and  practical.  It  provides  a  foundation  for  the  DoD  to  meet  the 


requirements  of  the  Training  Technology  Transfer  Act  of  1988  with  minimum  impact  on  its 
resources  and  maximum  opportunities  for  transfer. 

The  objectives  of  the  DoD  portability  effort  are  illustrated  in  the  progression  shown 
in  Figure  la-c.  Figure  la  illustrates  the  situation  without  portability.  In  this  case, 
application  software  must  be  uniquely  developed  for  different  operating  systems  and 
hardware  platforms.  The  interface  between  the  authoring  software  and  the  operating 
system  is  unique  and  usually  proprietary  for  each  combination  of  authoring  software, 
operating  system,  and  hardware  platform. 

The  current  status  of  DoD  portability  is  illustrated  by  Figure  lb.  It  may  be 
described  as  system  level  portability.  Its  goal  is  to  allow  application  software  to  run  on 
different  operating  systems  and  hardware  platforms  with  minimal  modiHcations  to  the 
application.  This  goal  is  rarely  reached  to  the  point  of  requiring  no  riKxlifications,  but  the 
current  scheme  of  portability  minimizes  these  modifications  and  facilitates  their 
implementation.  The  goal  has  largely  been  reached  by  the  effort  described  here  through 
q)ecification  of  a  virtual  device  interface. 

A  more  ambitious  objective  for  portability  is  illustrated  by  Hgure  Ic.  This  objective 
may  be  called  device  level,  or  plug-and-play  portaUlity.  Its  goal  is  not  only  for  application 
software  to  run  on  different  operating  systems  and  hardware  platforms  with  no 
modifications  to  the  application  (system  level  portability),  but  also  to  permit  substitution  of 
hardware  devices,  perbaps  supplied  by  different  nuuiufacturers,  in  hardware  platforms  widi 
no  nxxlifications  required  in  either  the  application  ot  the  q)erating  system  software.  This 
goal  has  been  achieved  for  high  fidelity  audio,  and  it  can  sitnilariy  be  accomplished  in  the 
ICW  world  through  specificaticm  of  a  virtual  device  interface. 

Work  on  the  systems  level  portability  illustrated  in  Figure  lb  has  been  completed 
for  ICW  programs  using  the  MS-DOS  operating  system  through  a  combination  of  DoD  and 
industry  effmrts  and  has  been  incorporated  in  Appendix  D  of  MIL-STD-1379D,  "Military 
Traiiting  Programs,"  issued  5  December  1990. 


ngur*  lc.  Standard  Archttactura  With  Davlca-Laval  Portability 
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B .  DEVELOPMENT  AND  MANAGEMENT  OF  ICW 


MIL-STD-1379D,  which  includes  the  ICW  portability  standard,  is  the  principal 
DoD  standard  for  training.  It  establishes:  (1)  procedures  to  follow  when  developing 
training  programs,  including  guidelines  for  writing  contracts  and  delivery  orders  for 
training;  (2)  requirements  for  using  DoD  Computo’-aided  Acquisition  and  Logistic  Support 
(CALS)  for  training  documents;  and  (3)  requirements  for  using  the  virtual  device  interface 
described  here. 

Additionally,  DoD  Instruction  1322.20,  "Development  and  Management  of 
Interactive  Courseware  (ICW)  for  Military  Training"  was  developed  and  issued  on 
14  March  1991.  lire  objective  of  this  instruction  is  increased  cost-effective  use  of  ICW  for 
military  training,  and  it  applies  to  all  interactive  courseware  developed  by  or  for  the  DoD. 

The  instruction  sets  flve  policies  for  the  development  of  new  and  substantially 
modified  ICW  programs  and  the  management  of  both  new  and  existing  ICW  programs  in 
the  DoD.  These  policies  are  the  following: 

(1)  ICW  programs  are  to  be  designed  u>  promote  portability,  following  the 
standard  DoD  programming  protocols  developed  under  the  DoD  portability 
initiative  and  other  technical  requirements  prescribed  in  MIL-STD-1379D. 

(2)  Payment  of  royalties,  recurring  license  or  run-time  fees,  use  taxes,  or  similar 
additional  expenses  for  ICW  and  associated  materials  developed  frar  or  by  the 
DoD  are  to  be  eliminated. 

(3)  The  Defense  Instructional  Technology  Information  System  (DITIS)  is 
established  to  provide  and  maintain  an  inventory  of  DoD  ICW  programs  for 
use  by  all  DoD  components.  DITIS  is  also  significant  for  non-DoD  woridorce 
issues  because  it  provides  essential  information  for  detennining  the  potential  of 
DoD  ICW  programs  for  transfer  to  the  private  sector. 

(4)  Reproduction  master  materials  must  be  archived  for  the  life  cycle  of  each  ICW 
program. 

(5)  DoD  Components  must  ensure  the  availability  of  all  materials  necessary  to 
modify  ICW  programs  throughout  their  ife  cycles. 

C.  PROCEDURES  FOR  TRANSFERRING  ICW 

The  DoD  (as  well  as  other  Federal  agencies)  has  provided  many  training  and 
education  audiovisual  materials  to  die  private  sector  throu^  an  existing  structure  within  the 
National  Audiovisual  Center,  which  is  an  operating  division  with  die  National  Archives  and 
Records  Administration,  as  outlined  in  the  Office  of  Management  and  Budget  (Circular 
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A-114,  "ManagementofFederal  Audiovisual  Activities."  Since  A-1 14  is  already  in  place, 
the  DoD  intends  to  use  it  as  much  as  possible  in  transferring  ICW  programs  to  the  private 
sector.  However,  ICW  programs  that  are  not  audiovisual  productions  are  not  covered  by 
these  provisions,  and  procedures  are  being  established  so  that  ICW  management,  including 
that  concerned  with  transferring  programs  to  the  private  sector,  is  consistent  across  all  ICW 
programs. 

General  procedures  for  transferring  all  DoD  ICW  programs  are  shown  in  Figure  2. 
First,  the  programs  must  be  screened  for  potential  relevance  to  the  new  target  audience  cm  a 
well-defined  set  of  criteria.  Those  ICW  programs  that  successfully  meet  these  criteria  must 
then  be  reviewed  by  legal  counsel  to  ensure  that  no  legal  encumbrances  preclude  their  sale 
to  the  public  and  then  be  subjected  to  a  security  review  to  determine  if  tfiey  can  be  cleared 
for  public  release.  ICW  programs  that  pass  these  reviews  will  then  be  available  for  transfer 
to  the  private  sectOT.  These  programs  will  be  offered  directly  as  they  were  produced  for  the 
DoD.  The  DoD  cannot  take  responsibility  for  any  costs  associated  with  secondary  user 
desired  content  changes,  editing,  duplication,  updates,  shipping,  technical  conversion, 
licensing,  patents,  or  royalties  associated  with  these  cleared  ICW  programs. 
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Figure  2.  Materials  Transfer  Process 

This  process  then  involves  three  "filters"  or  reviews  through  which  ICW  programs 
must  pass: 

(1)  Suitability  Review.  The  fvst  question  that  arises  about  a  DoD  ICW  programs 
is:  Would  anyone  else  want  it?  A  substantial  amount  of  DoD  instructional 
material  is  specifically  focused  on  the  main  business  of  the  DoD,  which  is 
warfighting.  Much  DoD  instructional  material  concerns  combat,  the  operation, 
maintenance,  and  deployment  of  materiel  required  for  combat,  and  procedures 
for  managing  large  military  organizations.  ICW  programs  directly  concerned 
with  combat  or  with  systems  and  procedures  that  are  only  used  for  combat  are 
excluded  from  further  consideration.  Some  ICW  programs  may  pass  this 
suitability  review  and  still  be  too  martial  in  tone  for  the  taste  of  many  civilian 
users,  but  at  this  point  the  issue  is  left  to  these  users  to  resdve  for  themselves. 


(2)  Legal  Review.  The  most  restrictive  review  for  DoD  ICW  programs  to  pass 
may  be  the  legal  review.  Here  the  question  is:  Does  the  DoD  have  the  legal 
right  to  provide  a  particular  ICW  program  for  copying  and  distribution  by 
others?  In  short,  does  the  DoD  own  it?  Many  DoD  ICW  programs  have 
restrictions  on  their  distribution  outside  the  DoD.  These  restrictions  are  the 
result  of  several  factors:  the  software  used  in  ICW  programs  may  be 
copyrighted;  imagery,  music,  and  sound  effects  used  in  audiovisual 
productions  may  be  copyrighted;  and  distribution  rights  may  be  restricted  to 
DoD  users  only.  Clearly,  the  DoD  does  not  have  the  right  to  copy  and 
distribute  these  matoials  outside  the  DoD. 

In  other  cases,  the  distribution  rights  for  the  materials  themselves  are 
unlimited,  but  the  means  to  present  them  may  be  limited.  This  is  especially 
lilrely  to  be  true  of  ICW  programs  in  which  instructional  content  the  curriculum 
data  base  of  items,  scenarios,  graphics,  photographies,  audiovisual 
productions,  and  the  like  is  only  part  of  the  instructional  package.  The  rules 
and  procedures  for  presenting  and  individualizing  the  instructional  content  are  a 
separate  matter.  The  content  may  be  wholly  owned  by  the  DoD  with  free  and 
unrestricted  rights  for  its  distribution  within  the  DoD,  but  the  rules  and 
procedures  for  presenting  it  may  involve  proprietary  algorithms,  licensing, 
royalties,  or  other  limitations  to  the  tights  of  the  DoD  to  transfer  it  to  non-D(d> 
users. 

(3)  Security  Review.  Classified  material  or  material  that  reveals  business 
proprietary  information  or  trade  or  technology  secrets  cannot  be  transferred  to 
the  private  sector.  Instructional  material  that  could  be  transferred  by  the  DoD 
to  die  private  sector  would  have  to  be  reviewed  to  deteimine  if  it  could  be  made 
available  for  public  release  and  unlimited  distribution  outside  the  DoD. 

DoDI  1322.20  is  intended  to  minimize  restrictions  on  the  transfer  of  new  ICW 
programs  and  of  those  undergoing  major  revisions.  However,  this  instruction  does  not 
cover  already  existing  ICW  programs,  and  it  will  not  sweep  away  all  barriers  to  ICW 
transfer.  Problems  of  resourcing  transfer  procedures,  establishing  responsibilities,  and 
adapting  to  inevitable  and  nqtid  technological  changes  in  ICW  remain  to  be  solved. 

The  general  process  for  transferring  DoD  ICW  programs  to  ntm-DoD  users,  then, 
centers  on  the  three  reviews  discussed  above.  All  three  reviews  will  certainly  result  in 
new,  non-mission-related  costs  that  the  DoD  will  have  to  bear  and  that  will  require 
additional  resources. 

Distribution  rights  to  ICW  programs  ranain  to  some  extent  uncharted  territory.  An 
adequate  body  of  decisions  for  establishing  legal  precedents  for  the  distributiem  of  ICW 
programs  to  outside  usos  has  yet  to  be  accumulated.  Qear  criteria  for  developing  ICW 
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programs  with  well-understood  distribution  rights  and  clear  criteria  for  determining 
distribution  rights  for  existing  ICW  programs  have  yet  to  be  developed. 

It  is  also  uncertain  what  legal  liability  issues  may  be  associated  with  transferring 
certain  ICW  materials  to  non-DoD  and  private  users.  Potentially  transferable  materials  may 
have  to  be  legally  reviewed  in  this  context  as  well. 

Once  these  reviews  are  completed,  the  instructional  materials  that  are  determined  to 
be  transferable  will  be  released  for  publication  in  a  catalog.  There  are  additional  tasks  that 
must  be  performed  by  non-DoD  organizations  to  complete  the  transfer  of  these  materials  to 
civilian  users.  Among  these  are  the  following: 

•  Catalog  Publication  and  Dissemination.  The  catalog  must  be  published  and 
disseminated  to  potential  users.  This  task  includes  maintaining  mailing  lists 
and  developing  a  capability  for  marketing  the  DoD  materials.  The  catalog  must 
include  materials  newly  entered,  previous  materials  that  have  been  updated, 
and  materials  whose  distribution  status  has  changed.  The  catalog  should  be 
maintained  in  a  digitally  accessible  format  as  well  as  in  a  paper  format 

•  Material  Location  and  Retrieval.  Transferable  materials  must  be  located  and 
retrieved.  ICW  programs  are  scattered  widely  across  DoD  conunands. 
Locating  and  securing  complete,  fully  workable  sets  of  ICW  programs  may 
consume  substantial  resources. 

•  Material  Storage.  Transferred  materials  must  be  physically  stored  with  aU 
necessary  environmental  safeguards.  These  materials  must  be  maintained  in 
good  working  order,  and  updated  and  modified  promptly  by  the  organization 
responsible  for  marketing  them.  Software,  hardware,  and  an  in-house 
technical  capability  must  be  available  in  order  to  provide  this  quality  assurance. 

•  Technical  Assistance.  Non-DoD  users  will  require  technical  assistance  in 
installing  the  DoD  materials  for  their  own  applications,  and  this  assistance  will 
have  to  be  provided  via  telephone  hot  lines,  technical  documentation,  technical 
bulletins,  user  group  seminars,  and  the  like. 

Other  tasks  may  well  develop  with  experience.  What  is  needed  is  an  adequately 
resourced  materials  transfer  organization  that  is  outside  the  DoD  but  that  has  clear 
responsibility  to  market,  technically  support,  and  transfer  DoD  ICW  programs  to  non-DoD 
users.  If  the  DoD  materials  and  other  government-developed  ICW  programs  are  of 
sufficient  value,  such  an  organization  should  become  self-supporting  through  sales  of  ICW 
programs  after  receiving  stan  up  support,  but  adequate  seed  funding  will  have  to  be 
provided  and  an  organizational  "home"  for  die  center  will  have  to  be  established. 


IV.  TRANSFERABLE  DoD  COURSEWARE 


The  DmS  database  was  analyzed  to  identify  ICW  programs  that  are 
candidates  for  tranter  from  the  DoD  to  the  private  sector,  although  final 
determination  of  tran^erability  will  depend  upon  the  results  of  more 
authoritative  smtability,  legal,  and  security  reviews  that  must  be  undertaken 
on  a  case-by-case  basis.  Out  of  4644  ICW  programs  that  have  been 
reported  to  DITIS  since  its  inception  in  May  1991, 2718  were  ident^ed  as 
having  possible  utility  in  meeting  private  sector  training  requirements.  Of 
these  2718  programs,  591  were  computer-based  instruction  programs  tlm 
run  on  the  MS-DOS  operating  system,  1997  were  computer-based 
instruction  programs  that  run  on  the  NOS  operating  system  and  were 
prepared  using  the  TUTOR  authoring  system,  and  130  were  interactive 
videodisc  programs  tha  run  on  the  MS-DOS  operating  system. 

The  DmS  database  is  the  only  DoD  database  that  will  satisfy  the  information 
reporting  requirements  of  the  Training  Technology  Transfer  Act  of  1988.  DoDI  1322.20 
requires  DoD  training  developers  to  determine  if  an  ICW  program  exists  that  meets  their 
needs  before  embarking  on  the  development  of  any  new  training  program,  and  DITIS  was 
established  by  the  instruction  as  a  resource  for  making  this  determination.  ICW  programs 
must  be  entered  into  DITIS  when  they  are  proposed,  put  under  development,  completed, 
modified,  taken  out  of  service,  or  terminated.  Full-scale  development  of  the  database  was 
begun  in  May  1991  when  the  Services  were  foimally  notified  of  the  requirement  to  register 
their  ICW  programs  in  DITIS. 

At  present,  4644  records  have  been  entered  into  DITIS  and  are  available  for 
analysis.  These  records  are  now  being  reviewed,  validated,  and  checked  for  coiiq>leteness. 
Also,  more  DITIS  records  are  being  added  all  die  time.  These  activities  are  contmuing  and 
should  substantially  increase  both  the  conqileteness  of  DITIS  coverage  and  the  quality  of  its 
records.  However,  the  4644  ICW  programs  now  in  DITTS  provided  an  initial,  credible 
basis  for  determining  the  amount  and  kinds  of  DoD  ICW  programs  that  may  be  transfoable 
to  private  sector  use. 

The  Service  developers  of  the  ICW  programs  reported  in  DITTS  are  listed  in 
Table  3.  As  the  table  shows,  most  of  the  ICW  programs  reported  came  from  the  Army 
(2134  programs),  Init  there  are  significant  numbers  of  programs  rqiorted  by  the  Navy  (331 
programs),  Air  Force  (655  programs),  and  DoD  (555  programs).  Most  of  the  DoD 
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programs  came  from  joint  commands,  and  most  of  the  programs  for  which  no  Service  was 
reported  as  the  developer  were  acquired  joindy,  by  two  or  more  Services.  Most  of  the 
programs  were  developed  by  active  con^nents  (2908  programs).  Only  14  programs  were 
developed  by  reserve  forces,  none  by  Nadonal  Guard  forces,  but  the  developing 
component  of  many  (1722)  programs  was  not  repmied. 

Table  3.  Sources  of  ICW  Programs  Reported  In  DITIS 


Service  (Component) 

No.  of 

Records 

Army  -  (Active) 

1380 

Army  -  (No  Response) 

754 

Total 

2134 

Navy  •  (Active) 

320 

Navy  -  (Reserve) 

11 

Total 

331 

Air  Force  •  (Active) 

638 

Ah'  Force  •  (Reserve) 

3 

Ah’  Force  •  (Other) 

14 

Total 

655 

Marine  Corps  •  (Active) 

5 

Coast  Guard  •  (Active) 

10 

DoD  -  (Active) 

555 

No  Response 

954 

Total 

4644 

Only  computer*based  instrucdon  and  interactive  videodisc  were  reported  in  DITIS 
as  delivoy  media  for  these  ICW  programs.  A  total  of  3499  programs  were  repotted  as 
computer-based  instruction,  96S  were  reported  as  interactive  videodisc  programs,  and  diere 
were  180  non-iesponses  in  which  the  deliveiy  media  data  element  was  left  blank. 
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The  infomiaticm  held  in  DITIS  is  detennined  by  its  data  elements,  which  are  defined 
by  DoDI  1322.20.  These  data  elements  and  their  definitions  are  listed  in  Appendix  A. 
Some  characteristics  of  DoD  ICW  programs  that  may  be  determined  from  these  data 
elements  as  they  have  been  reported  to  DITIS  are  shown  in  Table  4.  It  should  be 
emphasized  that  many  DITIS  records  are  in  their  eariy  developmental  phases  and  may  not 
be  authoritative.  Further  review  must  be  made  on  a  case-by-case  basis  to  determine 
conclusively  what  the  actual  status  of  an  ICW  program  listed  in  DITIS  is  with  regard  to  any 
of  its  data  elements. 


Table  4.  Reported  Characterietics  of  ICW  Programs  In  DITIS 


Distribution  Rsstrictions 

Security  Classification 

DoD  Rights 

Program  Status 

Rssoonss 

Response 

No.  of 
Programs 

Nona 

3095 

Unclassified 

4625 

Unlifflited 

239 

Proposed 

Legal 

53 

Confidential 

4 

Limited 

3900 

Daveiopment 

480 

Govammant  Only 

121 

Secret 

11 

Government  Use 

321 

Completed 

3983 

DoOOnly 

962 

No  Response 

4 

Other 

4 

Revision 

20 

Other 

99 

No  Response 

180 

Out  of  Service 

1 

No  Response 

314 

Terminated 

2 

Other 

2 

No  Response 

1 

Data  elements  that  are  particularly  important  in  determining  transferabiliQr  are  die 
following: 

•  Restrictions  to  Distribution,  If  diere  are  any  legal  restricdons  on  puUic 
distribution  of  an  ICW  program,  then  clearly,  and  in  accord  with  the 
procedures  outlined  earlier,  the  DoD  cannot  transfer  the  program  to  die  private 
sector.  As  Table  4  suggests,  309S  of  the  4644  ICW  programs  now  listed  in 
DITIS  have  no  reported  legal  restrictions  mi  their  distribution.  Again, 
authoritative  determination  of  diese  restrictions  must  be  made,  and  many  ICW 
programs  that  are  reported  to  be  unrestricted  may  turn  out,  after  further 
schitiny,  to  be  restricted. 

•  Security  Clearance  Required.  If  a  security  clearance  is  required  to  view  an 
ICW  program,  then  its  transferability  is  clearly  limited.  In  accord  with  the 
procedures  outlined  earlier,  only  unclassified  ICW  programs  will  be  released 
by  the  DoD  for  use  in  the  private  sector.  Security  classification  does  not 
iqipear  to  be  a  major  issue  in  the  transferability  of  DoD  ICW.  As  TaUe  4 
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shows,  4625  of  the  4644  ICW  programs  now  in  DITIS  are  reported  to  be 
unclassified. 

•  DoD  Rights  to  ICW  Programs,  A  specific  stipulation  in  the  Federal 
Acquisition  Regulations  determines  the  type  of  rights  to  a  product  held  by  the 
government  after  acquiring  it  DoD  rights  may  turn  out  to  be  a  major  issue 
since,  as  Table  4  shows,  unlimited  rights  were  reported  to  have  been 
purchased  for  only  239  of  the  4644  ICW  programs  in  DITIS  as  part  of  their 
acquisition.  In  one  sense,  the  4405  programs  for  which  die  DoD  t^s  not  own 
unlimited  rights  may  not  be  transferable  to  the  private  sector,  since  the  DoD 
does  not  strictly  own  them.  On  the  other  hand,  tl^  are  no  legal  restrictions  to 
the  distribution  of  3095  of  the  DoD  ICW  programs  in  DITIS,  and  peiiiaps 
these  programs  are  transferable  or  the  rights  to  these  programs  may  be 
purchased  from  the  miginal  supplier.  This  issue  remains  unresolved  in  general 
and  will  have  to  be  treated  on  a  case-by-case  basis  in  determining  the 
transferability  of  any  ICW  program.  This  problem  should  be  alleviated  in  new 
ICW  programs  that  follow  the  guidelines  established  by  DoDI  1322.20.  In 
this  report,  ICW  programs  whose  rights  have  not  been  purchased  by  the 
government  are  noneAeless  inclutkd  in  the  inventory  of  programs  that  are 
considered  candidates  for  transfer  to  the  private  sector. 

•  ICW  Program  Status.  One  factts*  that  might  be  considered  in  the  transfer  of  an 
ICW  program  is  whether  or  not  it  is  operational.  Proposed  ICW  programs 
must  be  entered  into  DITIS,  but  until  th^  are  actuaUy  ctnnpleted,  they  cannot 
veiy  well  be  tnuisfened.  At  present,  3983  of  the  4644  ICW  programs  now 
listed  in  DITIS  have  been  completed.  An  additional  480  programs  are  under 
active  development,  which  means  they  are  likely  to  be  completed,  and  20 
programs  are  being  revised,  giving  4483  ICW  programs  Aat  are  either 
genuinely  operational  or  are  likely  to  be.  The  ICW  programs  that  are 
inventor^  here,  however,  are  all  reported  in  DmS  as  being  "completed." 

•  Authoring  System  Product  Name.  An  authoring  system  is  a  specialized 
strftware  package  designed  to  help  developers  prepare  instructional  material  for 
presentation  as  ICW.  ICW  prepared  with  some  authtHing  systems  require  a 
runtime  version  of  the  system  to  be  used  in  presenting  the  instructimi  to 
students.  In  some  of  these  cases,  die  DoD  may  have  frill  rights  to  distribute  tiie 
instructional  materials,  but  the  necessary  runtime  version  of  die  audioring 
system  must  be  obtained  separately  if  transfer  of  the  ICW  is  to  be  fully 
Reefed.  The  information  in  Dms  does  not  identify  these  cases,  and  diey  are 
expected  to  be  mininuzed  in  the  future  as  DoDI  1322.20  takes  hold.  The 
number  of  ICW  {nograms  prepared  for  DoD  use  with  each  audKxing  system  is 
shown  in  Table  5.  As  the  table  shows,  TUTOR  was  used  to  prqiare  2474  of 
die  4644  ICW  programs  in  DITIS,  and  MicroTUTOR  was  used  to  prepare  584 
others.  TUTOR  programs  require  a  proprietary  conqiuter  operating  system 
(NOS)  and  architecture  for  dieir  presentation.  MicroTUTOR  programs  can  be 
presented  by  most  MS-DOS  systems.  It  is  likely  that  many  the  TUTOR 
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Tabit  5.  Authoring  Systems  Used  to  Prepare  ICW  Programs  in  DITIS 


programs  could  be  successfully  translated  to  MicroTUTOR,  and  many  of  the 
DoD  TUTOR-based  ICW  programs  may  be  of  interest  to  the  private  sector,  but 
this  translation  is  not  a  fully  automated  process  and  would  have  to  be 
resourced. 

•  Operating  System.  An  operating  system  is  a  computer  program  that  schedules 
access  to  a  computer  system's  resources,  increases  the  efficiency  with  which 
implication  programs  run,  and  makes  using  the  computer  system  easier  and 
more  convenient  for  programmers  and  other  users,  including  students.  The 
operating  system  cm  which  an  ICW  program  runs  affects  the  ease  with  which 
ICW  can  be  transferred.  If  the  opoating  system  is  widely  used,  "open,"  and 
generally  available,  cost-effective  transfer  is  more  likely  to  be  achieved  than  if 
it  is  not.  Two  operating  systems  dominated  the  DIllS  reports:  MS-DOS 
supporting  1792  ICW  programs  and  NOS  supporting  2474.  NOS  runs  on 
mainframe  computers  manufactured  by  one  supplier,  MS-DOS  runs  on  a 
variety  of  computer  systems.  NOS  supports  the  TUTOR  authoring  system; 
MS-DOS  supports  a  variety  of  authoring  systems,  including  MicroTUTOR. 

•  Delivery  Medium.  Although  DoDI  1322.20  lists  eight  possittiUties  for  this  data 
element,  only  two  delivery  media  were  repmted  in  the  current  DmS  reccmls. 
These  are  ctmiputer-bas^  instructimi,  which  was  reported  fra*  3499  ICW 
programs,  and  interactive  videodisc  instruction,  which  was  reported  for  965 
ICW  programs;  180  DmS  records  did  not  report  this  data  element  Witiitime, 
the  number  of  recrads  reporting  CD-ROM  as  a  delivery  medium  should 
increase,  but  none  has  been  n^Kirted  yet 

Potentially  transferable  programs  are  reported  in  three  categories:  (1)  MS-DOS 
programs  using  computer-based  instructirai  fra  their  instructional  presentations,  (2)  NOS 
programs  using  computer-based  instruction  fra  their  instructiraial  presentations  (developed 
using  TUTOR),  and  (3)  MS-DOS  programs  using  interactive  videodisc  (TVD)  fra  their 
instructional  presentations. 

MS-DOS  computer-based  instruction  is  the  most  easily  transferable  of  DoD  ICW 
programs  because  of  the  provisions  of  DoD  1322.20,  the  requirements  of  MIL-STD- 
1379D,  and  the  widespread  availability  of  MS-DOS  conq>uter  systems. 

TUTOR  conputer-based  ICW  programs  were  examined  as  a  group  because  of  their 
large  number  and  general  ipplicability  to  private  sector  concerns.  However,  they  require 
an  operating  system  arxl  a  conputer  system  architectute  that  is  not  widely  availaUe  to  either 
militaty  or  private  education  and  training  communities.  TUTOR  programs  can  be  and  have 
been  prepared  to  operate  on  MS-DOS  systems,  usually  by  translating  them  to 
MicroTUTCXl.  This  translation  can  be  80*90  percent  automated,  and  it  is  available  from  a 
number  of  siqrpliets,  naaldng  diis  investment  attractive  from  a  cost-benefit  standpoint  fra 
many  TUTCMl  programs 


Finally,  interactive  videodisc  (IVD)  programs  were  separated  from  the  others 
because  they  can  be  treated  as  audiovisual  materials,  and  there  already  exists  a  DoD 
procedure  for  releasing  audiovisual  materials  including  interactive  videodisc  ICW  programs 
for  sale  to  the  public  through  the  National  Audiovisual  Center.  Also,  IVD  materials  were 
separated  out  because  they  require  a  different  suite  of  presentation  hardware  (they  require  a 
computer  system  connected  to  a  videodisc  player),  and  the  status  of  many  of  these 
programs  with  regard  to  distribution  rights  and  copyright  is  less  certain  than  it  is  for  most 
cotrq)uter-based  instruction. 

An  assessment  was  made  of  the  ICW  programs  in  each  of  these  three  categories  to 
determine  their  potential  for  transfer.  More  specifically,  the  screenings  suggested  earlier 
were  applied  to  the  4644  ICW  programs  now  reported  in  DmS.  ICW  programs  that  dealt 
only  with  military-specific  equipment  or  procedures,  course  management  tools  without 
accompanying  training  packages,  and  non-training  computer  programs  and  applications 
software  were  omitted.  Following  this  initial  screening,  the  remaining  ICTW  programs  were 
screened  to  select  those  that  provide  instruction  in  a  competency,  job,  or  vocational  area 
that  may  be  needed  in  the  private  sector. 

In  order  to  characterize  and  better  describe  the  final  set  ctf  ICW  programs,  they  were 
clashed  into  four  general  categories  based  on  their  content: 

•  Basic  Uteracy  and  General  Education  covers  topics  in  general  education, 
including  all  basic  verbal  and  mathematical  literacy  skills,  preparatimi  for 
education  in  specific  subject  areas,  preparation  for  educatiotud  certificatitm 
tests,  learning  skills  (especially  learning  to  learn),  and  personal  develqmient 
skills  necessary  to  functicxi  as  an  adult  in  modem  society. 

•  Sp^ific  Technical  Training  covers  ICW  jffograms  crmceming  instiuctum  in  the 
knowledge  and  skills  needed  to  perform  non-professional  jobs,  i.e.,  jobs  that 
do  not  require  education  in  die  general  liberal  arts  or  sciences  or  advanced 
study  in  a  specialized  field.  Most  of  these  programs  are  intended  to  prepare 
students  to  perform  a  specific,  identifiable  job. 

•  Workplace  Knowledge  and  Skills  covers  ICW  programs  providing  instractitm 
in  knowledge  and  skills  necessary  to  direct  and  administer  groups  of  people  or 
organizational  procedures. 

•  Professional  and  Para-Professional  Knowledge  and  Skills  covers  ICW 
programs  providing  instruction  to  maintain,  update,  and  inqnove  vocaticm- 
r^iecific  knowledge  and  skills  related  to  specialized  fields  requiring  advanced 
education  and  training. 
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The  categories  used  to  classify  DoD  ICW  programs  do  not  map  exactly  onto  the 
five  categories  of  competencies  sought  by  managers  in  the  private  sector.  This  is  not 
surprising  since  the  DoD  ICW  programs  were  developed  for  specific  DoD  needs. 
However,  there  are  areas  of  overlap  between  the  DoD  categories  and  the  woricforce 
competencies  sought  by  the  private  sector.  Specifically,  the  five  private  sector  competency 
areas  can  be  napped  CHito  the  DITIS  inventory  in  the  following  ways; 

•  Personal  Characteristics  and  Attitudes.  This  competency  is  addressed  by  the 
DmS  Basic  Skills  Training  and  General  Education  category  of  "Personal 
Development,"  which  covers  the  practical  skills  needed  for  daily  living.  In 
addition,  the  General  Workplace  Knowledge  and  Skills  category  contains  the 
subcategory  "Personal  Job  Skills,"  which  presents  non-task-related  knowledge 
and  skills  that  generally  enhance  workers'  effectiveness  on  the  job  and  within 
an  organizatitm. 

•  Interpersonal  and  Teamwork  Skills.  These  competencies  relate  to  two  DmS 
subcategories.  The  General  Workplace  Knowledge  and  Skills  subcategory 
"Leadership"  presents  principles  for  supervising  others  in  the  workplace  in 
order  to  increase  task  efficiency  and  performance,  and  the  subcategory 
'Teamwork"  covers  procedures  for  enhancing  coqrerative  efforts  to  complete  a 
task  or  job. 

•  Higher  Order  Thinking  Skills.  These  skills  are  covered  in  the  Basic  Skills 
Training  and  General  Education  subcategory  of  "Academic  Skills,"  which 
includes  learning  strategies  (e.g.,  listening,  memorizing,  note  taking,  studying, 
test  taking,  reading  strategies)  and  reference  skills  (e.g.,  finding  information  in 
the  library,  finding  information  in  books,  skimming  for  relevant  information, 
organizing  information  from  multiple  sources).  Also  the  DITIS  inventory 
includes  the  subcategory  "Higha*  Order  Skills,"  which  includes  problem 
solving  (especially  the  application  of  knowledge  and  skiUs  to  novel  situations) 
and  spatial  relations  (mental  manipulation  of  two-  and  three-dimension 
objects). 

•  Basic  Academic  Skills.  This  competency  is  directly  addressed  by  the  DITIS 
category  Basic  Skills  Training  and  General  Education.  It  includes  language 
skills  (e.g.,  general  language  skills,  applied  language  skills,  general 
vocabulary,  job-related  terminology,  English  as  a  second  language)  and 
mathematics  skills  (general  mathematics  skills,  applied  mathematics  skills,  and 
advanced  mathematics  skills).  This  general  category  also  covers  tqncs  related 
to  physical  sciences,  social  sciences,  and  foreign  language  and  culture. 

•  Job-Specific  Technical  Skills.  These  competencies  are  directly  addressed  by 
almost  every  subcategory  in  the  DITIS  Spedfic  Technical  Trairung  categtny  as 
well  as  by  many  subcategmies  in  the  Workplace  Knowledge  and  Skills  and  in 
the  Professional  and  Para-Ptofesrional  Knowledge  and  Skills  categories. 


A.  MS-DOS  COMPUTER-BASED  INSTRUCTION 


Of  the  4644 ICW  programs  now  in  DITIS,  1 800  were  reported  as  being  prepared 
for  operatitxi  on  the  MS-DOS  operating  system.  Of  these,  854  were  reported  as  computer- 
based  instruction  and  the  remaining  946  were  reported  as  interactive  videodisc  instruction. 
The  final  set  of  MS-DOS  computer-based  instruction  entries  was  selected  based  on  the 
foUowing  criteria: 

•  As  suggested,  the  program  is  reported  to  be  MS-DOS  computer-based 
instruction. 

•  No  restrictitms  are  reported  on  its  distribution  to  the  public. 

•  The  development  or  acquisition  of  die  program  has  been  completed. 

•  Its  security  classification  is  reported  as  "Unclassified." 

•  There  may  be  a  need  in  the  private  sector  for  the  competency,  job,  or 
vocational  area  for  which  it  provides  instruction. 

There  were  591  of  the  854  MS-DOS  computa--based  instruction  programs  that  met 
these  criteria.  An  inventory  that  shows  into  which  subject  categories  these  programs  may 
be  categorized  is  provided  in  Table  6.  It  should  be  emphasized  that  the  counts  shown  in 
Table  6  are  based  solely  on  data  currently  contained  in  DmS  and  would  probably  change 
upon  closer  review  of  the  programs  themselves.  Still,  this  inventory  gives  a  sense  of  the 
variety  and  number  of  DoD  MS-DOS  computer-based  instruction  programs  that  may  be 
a^rplicable  outside  the  DoD.  With  the  exception  of  a  large  cluster  (263  programs)  of  MS- 
DOS  con^uter-based  instruction  programs  for  air  traffic  control  and  the  general  absence  of 
these  programs  from  the  General  Education  subcategory,  they  appear  to  be  fairly  evenly 
distributed  across  all  the  subject  categories. 

B.  NOS  (TUTOR)  COMPUTER-BASED  INSTRUCTION 

Of  the  4644  ICW  programs  now  in  DITIS,  2472  were  repotted  as  being  prepared 
using  the  TUTOR  authoring  language  for  operation  on  the  NOS  (qrerating  system.  The 
final  set  TUTOR  cotrqruter-based  instraction  entries  was  selected  based  cm  the  following 
criteria: 

•  As  suggested,  the  program  is  reported  to  be  computer-based  instruction 
prqrated  using  tire  TUTOR  authoring  language  for  the  NOS  operating  system. 

•  No  restrictions  are  rqxnted  on  its  distribution  to  the  public. 

•  The  development  or  acquisition  of  tire  program  has  been  oon^leted. 


IV-9 


Table  6.  Counts  of  Candidate  ICW  Programs 


I.  BASIC  SKILLS  TRAINING  AND  GENERAL  EDUCATION 


Number  of  Programs 


Subject  Category 

Total 

MS-DOS 

IVD 

TUTOR 

A.  Basic  Skills 

1.  Academic  Skills 

a.  Learning  Strategies 

36 

4 

32 

b.  Reference  Skilis 

36 

36 

2.  GeneralJob Skills 

a.  Charts,  Diagrams,  and  Schematics 

13 

13 

b.  Tool  and  Equipment  Use 

56 

3 

8 

45 

c.  Miscellaneous 

15 

15 

3.  Higher  Order  Skills 

a.  Problem  Solving 

34 

34 

b.  Spatial  Relations 

4.  Language  Skiils 

30 

30 

a.  General  Language  Skills 

15 

15 

b.  Applied  Language  Skills 

30 

2 

28 

c.  Gemrai  Vocabulary 

23 

23 

d.  Job-Related  Terminology 

79 

18 

61 

e.  English  as  a  Second  Language 

1 

1 

5.  Mathematics  Skills 

a.  General  Mathematics  Skais 

86 

1 

3 

82 

b.  Applied  Mathematics  Skills 

76 

10 

66 

c.  Advanced  Mathematics  Skills 

58 

1 

57 

6.  Personal  Development 

20 

20 

B.  General  Education 

1.  Test  Preparation 

a  AFCT 

6 

6 

b.  CLEP 

c.  GED 

6 

6 

d.  GRE 

5 

5 

2.  Physical  Sciences 

a.  Basic  Science 

b.  Biochemistry 

3 

3 

c.  Biology 

d.  Chemistry 

4 

4 

e.  Geology 

4 

2 

2 

f.  Physics 

2 

2 

3.  Social  Sciences 

a  Behavioral  Sciences 

b.  Economics 

c.  Geography 

d.  Political  Science 

(continued) 
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Table  6.  Counts  of  Candidate  ICW  Programs  (continued) 


I.  BASIC  SKILLS  TRAINING  AND  GENERAL  EDUCATION  (continued) 


Number  of  Programs 


Subject  Category 

Total 

MS-DOS 

IVD 

TUTOR 

B.  General  Education  (continued) 

3.  Social  Sciences 

a. 

Behavioral  Sciences 

b. 

Economics 

c. 

Geography 

d. 

Political  Science 

4.  Foreign  Language  and  Culture 

a 

Arabic 

11 

11 

b. 

Chinese 

4 

4 

c. 

Czech 

9 

9 

d. 

Egyptian 

1 

1 

e. 

French 

4 

4 

f. 

German 

32 

1 

31 

g- 

Greek 

1 

1 

h. 

Hebrew 

i. 

Italian 

6 

6 

j. 

Japanese 

21 

21 

K. 

Korean 

2 

1 

1 

1. 

Latin 

4 

4 

m. 

Norwegian 

n. 

Polish 

5 

5 

0. 

Portuguese 

39 

39 

P- 

Russian 

q- 

Serbo-Croatian 

1 

1 

r. 

Spanish 

47 

1 

46 

s. 

Swedish 

t. 

Syrian/Iraqi 

1 

1 

u. 

Tagalog 

V. 

Thai 

w. 

Turkish 

1 

2 

X. 

Vietnamese 

1 

_ )L. 

Miscellaneous 

5 

Total  Basic  Sklis  Training  and 

General  Education  ICW  Proorams 

835 

41 

16 

778 

(continued) 
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Table  6.  Counts  of  Candidate  iCW  Programs  (Continued) 


II.  SPECIFIC  TECHNICAL  TRAINING 

Number  of  Programs  # 


Subject  Category 

Total 

MS-DOS 

IVD 

TUTOR 

A. 

Automotive  Mechanics 

48 

1 

47 

B. 

Aviation 

1 

1. 

Aerodynamics 

5 

5 

2. 

Aeronautics  and  Astronautics 

3. 

Air  Traffic  Control 

270 

263 

7 

4. 

Aircraft  Familiarization 

6 

5 

1 

5. 

Aircraft  Maintenance 

36 

1 

1 

34 

6. 

Emergency  Procedures 

5 

5 

7. 

Flight  Crew  Training 

8. 

Flight  Inspection 

37 

37 

9. 

Flight  Planning 

10. 

Flying  Fundamentals 

11 

1 

10 

11. 

12. 

Ground  Training 

Helicopter  Repair 

2 

3 

13. 

Instmment  Landing  Systems  (ILS) 

46 

46 

14. 

Pilot  Training 

32 

4 

1 

27 

C. 

Communications  and  Communications 
Equipment 

22 

2 

2 

18 

D. 

Computers 

1. 

Data  Communications 

2 

2 

2. 

Data  Processing 

9 

9 

3. 

Fundamentals 

20 

4 

16 

4. 

Hardware 

12 

3 

9 

5. 

Military  Computer  Systems 

6. 

Operating  Systems 

1 

1 

7. 

Operations 

8. 

Programming  Languages 
a  Ada 

5 

5 

b.  BASIC 

2 

2 

c.  C 

19 

19 

d.  COBOL 

44 

12 

32 

e.  ECL 

f.  FORTRAN 

g.  GMAP 

h.  JCL 

i.  MASM 

5 

5 

j.  PASCAL 

1 

1 

k.  PROLOG 

l.  RPG 

m.  SOL 

n.  STORM 

1 

1 

9. 

Security 

6 

5 

1 

10. 

Software  and  Applications  Programs 

6 

1 

5 

11. 

Word  Processiiig 

2 

2 

12. 

MisceRaneous 

1 

1 
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Table  6.  Counts  of  Candidate  ICW  Programs  (Continued) 

II.  SPECIFIC  TECHNICAL  TRAINING  (continued) 


Number  of  Programs 


Subject  Category 

Total 

MS-DOS 

IVD 

TUTOR 

E.  Electronics 

1 .  Fundamentals 

77 

31 

46 

2.  Generic  Electronic  Equipment 

Operation  and  Maintenance 

3.  Safety 

3 

1 

2 

4.  Tool  and  Equipment  Use 

39 

14 

25 

F.  Hydraulics  and  Pneumatics 

15 

1 

2 

12 

G.  Journalism 

1 .  Broadcast 

3 

3 

2.  Photo 

7 

7 

3.  Print 

5 

5 

H.  Maintenance  (Miscellaneous) 

4 

2 

1 

1 

I.  Map  Reading 

33 

1 

1 

31 

J.  Materials  Harxlling  and  Storage 

5 

1 

1 

3 

K.  Navigation 

1.  Air 

32 

12 

20 

2.  Celestial 

1 

1 

3.  Nautical 

1 

1 

4.  Rules  of  the  Nautical  Road 

2 

2 

L.  Postal  Procedures 

7 

3 

4 

M.  Radar  and  Sonar 

106 

43 

3 

60 

N.  Safety 

30 

1 

29 

0.  Security,  Law  Enforcement, 

and  Criminology 

2 

1 

1 

P.  Soldering  and  Welding 

Q.  Typing 

23 

12 

11 

R.  Miscellaneous 

6 

1 

1 

4 

Total  Specific  Technical  Training 

1060 

391 

69 

600 

(continued) 
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Table  6.  Counts  of  Candidate  ICW  Programs  (Continued) 


lU.  WORKPLACE  KNOWLEDGE  AND  SKILLS 


Number  of  Programs 


Subject  Category 

Total 

MS-DOS 

IVD 

TUTOR 

A.  Finance  and  Accounting 

34 

2 

32 

B.  Instnjction  and  Training 

39 

3 

36 

C.  Management 

1 .  Teamwork 

18 

1 

17 

2.  Leadership 

6 

2 

4 

3.  Perfomrance  Appraisal 

9 

1 

8 

D.  Office  Management 

1 .  Document  Control 

2 

2 

2.  Administration 

10 

9 

1 

3.  Secretarial  Skills 

a  Correspondence 

16 

5 

11 

b.  Filing 

31 

31 

c.  Other  Forms  and  Procedures 

8 

7 

1 

E.  PersonalJob Skills 

10 

10 

F.  Personnel  Policies  and  Employee 

Relations 

1.  General 

18 

3 

15 

2.  Government-specific 

35 

7 

28 

3.  Equal  Employment  Opportunity 

29 

29 

and  Affimiative  Action 

G.  Miscellaneous 

5 

1 

4 

Total  Workplace  Knowledge  and  Skills 

270 

42 

1 

227 

(continued) 
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Table  6.  Counts  of  Candidate  ICW  Programs  (Continued) 


IV.  PROFESSIONAL  AND  PARA-PROFESSIONAL  KNOWLEDGE  AND  SKILLS 


Number  of  Programs 


Subject  Category 

Total 

MS-DOS 

IVD 

TUTOR 

A.  Engineering 

1 .  Civil  Engineering  (General) 

4 

2 

2 

a  Bridge  Design 

32 

11 

21 

b.  Concrete 

6 

3 

3 

c.  Constnjction  Management 

3 

1 

2 

d.  Drainage  Facflities 

16 

6 

10 

e.  Materials  Quality 

11 

5 

6 

f .  Road  and  Airfieid  Construction 

31 

12 

19 

2.  Combat  Engineering 

3.  Electrical  Engineering 

1 

1 

4.  Mechanicai  Engineering 

2 

2 

5.  Production  Control  Management 

14 

14 

B.  Medicine 

1 .  Anatomy  and  Physiology  (General) 

55 

16 

31 

2.  Basic  Medical  SklHs 

18 

5 

3.  Combat  Medicine 

4 

4.  Dental  Science 

27 

5 

19 

5.  First  Aid,  Emergency  Treatment, 

and  Medicai  Readiness 

28 

1 

11 

16 

6.  Health  Care  Administration 

29 

9 

20 

7.  Infectious  Diseases 

8 

8 

8.  Laboratory  Technology 

10 

10 

9.  Medical  Technology 

36 

2 

34 

10.  Nursing 

12 

12 

11.  Nutrition  and  Weiiness 

21 

3 

18 

12.  Pharmacology 

19 

9 

10 

13.  Public  Health 

4 

4 

14.  Medical  Specialties 

a  Allergies 

9 

b.  Behavior/Psychiatry 

4 

1 

c.  Cardiology 

20 

5 

1 

d.  Clinical  Medk:ine 

5 

1 

4 

e.  Dermatology 

2 

2 

f .  Ear,  Nose  and  Throat 

g.  Endocrinology 

5 

2 

1 

2 

h.  Neurology 

5 

2 

3 

i.  Obstetrics/Gynecology 

2 

2 

j.  Oncology 

2 

2 

k.  Optometry/Ophthalmology 

32 

12 

20 

1.  Orthopedics 

2 

2 

m.  Pulmonary  Medicine 

39 

2 

1 

36 

n.  Radiology 

8 

8 

0.  Surgery 

14 

5 

9 

D.  Uroloav 

3 

1 

2 

(continued) 
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Table  6.  Counts  of  Candidate  ICW  Programs  (Continued) 

IV.  PROFESSIONAL  AND  PARA-PROFESSIONAL  KNOWLEDGE  AND  SKILLS  (continued) 


Number  of  Programs 


Subject  Category 

Total 

MS-DOS 

IVD 

TUTOR 

B.  Medicine  (continued) 

15.  Veterinary  Medicine 

5 

5 

16.  Miscellaneous 

5 

2 

3 

553 

117 

44 

392 

Overall  Totals 

2718 

591 

130 

1997 

•  Its  security  classification  is  reported  as  'Unclassified.'' 

•  There  may  be  a  need  in  the  private  sector  for  the  competency,  job,  or 
vocatitxial  area  for  which  it  provides  instruction. 

There  were  1997  of  the  2472  TUTOR  computer-based  instruction  programs  that 
met  these  criteria.  An  inventory  that  shows  inre  which  subject  categwies  these  TUTOR 
programs  may  be  categorized  is  provided  in  Table  6.  As  above,  the  counts  shown  in  Table 
6  are  based  solely  on  DITIS  entries  and  would  probably  change  given  closer  examination 
of  the  programs.  Still,  this  inventory  gives  a  sense  of  the  variety  and  number  of  TUTOR 
con^uter-based  programs  that  may  be  applicable  outside  the  DoD.  There  is  a  TUTOR 
program  in  almost  every  subject  category  listed.  As  discussed  earlier,  commercial 
programs  available  fn»n  several  suppliers  will  auttnnate  die  translation  of  80-90  pererat  of 
these  TUTOR  programs  to  MicroTUTOR  and  thereby  to  a  form  that  can  be  presented  cm 
most  MS-DOS  computer  systems.  Roughly,  1-3  person-weeks  are  required  to  translate  a 
TUTOR  program  to  MicroTUTOR. 

C.  MS-DOS  INTERACTIVE  VIDEODISC  INSTRUCTION 

Of  the  1800  ICW  programs  in  DITIS  repented  to  operate  on  die  MS-DOS  operating 
system,  946  use  interactive  videodisc  (TVD)  instructiem.  The  final  set  of  MS-DOS  IVD 
instructiem  programs  was  selected  based  cm  the  fcdlowing  criteria: 

•  As  suggested,  the  program  was  reported  to  be  interactive  videodisc  instruction 
prqiaied  for  the  MS-DOS  operating  systoa 

•  The  development  or  acquisitkm  of  die  program  has  been  conqileted. 

•  Its  security  classificatiem  is  reported  as  'Unclassified." 


•  There  may  be  a  need  in  the  private  sector  for  the  competency,  job,  or 
vocatitmal  area  for  which  it  provides  instruction. 

Lack  of  repOTted  restrictions  for  distribution  to  the  public  was  not  among  the  criteria 
for  selecting  ICW  programs  in  the  category  of  MS-DOS  IVD  instruction.  Many  of  these 
programs  are  new,  and  review  of  their  distribution  rights  is  currently  underway.  It  seems 
fair  to  identify  these  ICW  programs  as  candidates  for  transfer  as  long  as  it  is  recognized 
that  their  distributitxi  tights  are  stiU  being  determined  and  may  turn  out  to  be  restricted. 

There  were  130  IVD  instruction  programs  that  met  the  criteria  Iot  inclusion  in  the 
Table  6  inventory  of  ICW  programs  that  are  candidates  for  transfer.  The  percentage 
(14  percent)  of  IVD  programs,  then,  that  met  these  criteria  is  much  lower  than  the 
corresponding  percentages  for  MS-DOS  computer-based  instruction  (69  percent)  and 
TUTOR  con^uter-based  instruction  (81  peicoit).  This  relatively  low  percentage  appears  to 
be  due  to  the  large  number  of  IVD  programs  the  DoD  has  developed  to  train  operators  and 
maintainers  of  specialized  military  systems  and  are  therefore  not  candidates  for  transfer  to 
the  private  sector.  Table  6  shows  into  which  subject  categories  the  IVD  programs  that  ate 
candidates  for  transfer  may  be  categorized.  As  before,  the  counts  shown  in  Table  6  are 
based  solely  on  DITIS  entries  and  would  probably  change  given  closer  examination  of 
these  ICW  programs.  Still,  this  inventory  gives  a  sense  of  the  varieQ^  and  number  of  DoD 
IVD  programs  that  might  be  applicable  in  private  sector  training. 
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V.  CONCLUSIONS 


Based  on  the  above  considerations  and  the  resulting  inventories  of  DoD  ICW 
programs  that  appear  to  be  transferable  to  the  private  sector,  the  following  conclusions  may 
be  drawn; 

•  A  number  of  DoD  ICW  programs  appear  to  be  candidates  for  transfer  to  the 
private  sector,  but  Anal  judgements  on  their  transferability  require  more 
authoritative  and  comprehensive  reviews  that  must  be  performed  on  a  case-by¬ 
case  basis.  Many  of  these  ICW  programs  have  proven  to  be  of  significant 
value  in  DoD  training  and  may  be  useful  in  meeting  private  sector  workforce 
training  requirements  if  they  can  be  transferred. 

•  Wmkable  procedures  are  already  in  place  to  aid  in  the  transfer  of  DoD  ICW 
programs  that  are  audiovisual  productions,  such  as  interactive  videodisc 
programs.  These  procedures  serve  as  a  model  for  effecting  transfer  of  other 
ICW  programs  that  are  not  audiovisual  productions,  such  as  computer-based 
instruction  programs. 

•  The  problems  of  resourcing  and  responsitnlities  remain.  Through  its  policies 
and  procedures,  the  DoD  is  prepared  to  assist  the  private  sector  in  making  DoD 
ICW  programs  available  for  transfer,  but  resources  both  within  the  DoD  and 
outside  die  DoD  remain  to  be  identi&d  and  responsibilities  for  many  necessary 
functions,  especially  those  to  be  performed  outside  the  DoD,  remain  to  be 
assigned. 

In  brief,  transfer  of  ICW  programs  fiom  the  DoD  to  die  private  sector  appears  to  be 
a  potentially  useful  approach  for  meeting  some  ncm-DoD  workforce  training  requirements. 
Actual  transferability  of  specific  ICW  programs  must  be  determined  authcvitatively  on  a 
case-by-case  basis,  and  a  number  of  issues,  particulaiiy  those  involving  the  availability  of 
resources  and  the  establishment  of  responsibilities,  must  be  resolved  before  a 
comprehensive  set  of  procedures  for  transfer  can  be  developed  and  successfully 
inqilemented. 
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APPENDIX  A 
DITIS  DATA  ELEMENTS 


SECTION  A;  ADMINISTRATIVE  INFORMATION 

This  section  is  to  be  completed  for  a  proposed  development,  or  any  time  a  DITIS 
database  query  is  initiated.  The  section  consists  of  eight  data  elements  organized  into  the 
following  four  blocks: 

1 .  Date.  The  date  this  record  is  forwarcted  to  DITIS.  Entry  format  is  complete 
year,  month,  and  day  (e.g.,  22  August  1995  is  entered  as  19950822). 

2.  DmS  Record  Number.  The  alphanumeric  tracking  number,  developed  by  the 
originating  activity,  that  is  used  to  identify  the  ICW  program  record  within  the  DITIS 
database.  The  number  consists  of  five  parts,  separated  by  hyphens,  as  follows: 

C  s  One  character  code  to  denote  the  service  of  the  lead 

Component  for  the  ICW  program. 

A=  Army 
F  =  AirFbice 
N  =  Navy 
M=  Marine  Corps 
P=  Coast  Guard 
Ds  Dqrartment  of  Defense 
0=  Other 

S=  One  character  code  to  denote  the  unit  status  (rf  the  activity 

responsible  for  the  development  of  the  ICW  program 
R=  Active 
G  =  Guard 
V=  Reserve 
0=  Other 
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NAME  =  First  four  lettm  of  the  last  name  of  the  Service  program 

manager,  point-of-contact,  or  similar  individual  in  the 
originating  activity. 

YYYYMMDD  =  The  date  on  which  data  regarding  this  program  are  first 

entered  into  the  DITIS.  Entry  format  is  complete  year, 
month,  and  day.  (e.g.,  19950822). 

UUMM  =  A  unique  six  digit  number 

3.  ICW  Program  Status.  Code  to  denote  the  current  phase  of  the  program  for 
which  data  are  being  submitted  to  DmS: 

Q  -  Query  only 

P  -  Proposed  development 

U  -  Underdevelopment 

C  -  Development  or  acquisition  completed 

R  -  Program  revision 

S  >  Out  of  service 

T  >  Program  terminated 

O  -  Other  (specify) 

4a.  Originating  Activity  Organization  Name.  The  full  name  of  the  Government 
activity  responsible  for  the  development  of  the  ICW  program  (e.g..  Chief  of  Naval 
Education  and  Training;  USA  Training  and  Doctrine  Command;  USAF  Air  Training 
Command).  If  the  current  data  entry  is  part  of  a  query,  the  full  name  of  the  Government 
activity  requesting  the  data  search. 

4b.  Originating  Activity  Office  Symbol.  The  full  office  symbol  of  the 
Government  activity  responsible  for  the  development  of  the  ICW  program  (e.g.,  CNET, 
Program  Management  Support  Activity,  Code  0474;  HQ  TRADOC  Atm:  ATTG-Cl;  HQ 
ATC/TTOR).  If  the  current  data  entry  is  part  of  a  query,  the  full  office  symbol  of  the 
Govenunent  activity  requesting  the  data  search. 

4c.  Originating  Activity  Point-of-Contact  fPQO  Name.  The  name  and  title  of  the 
person  at  die  miginating  activity  who  is  most  knowledgeable  about  the  program  content  and 
features. 

(1)  Commercial.  The  cmnmercial  telephone  number,  including  area  code, 
of  the  originating  activi^  (e.g.,  (407)  555-1234). 
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activity. 


(2)  AUTOVON.  The  AUTOVON  telephone  number  of  the  originating 


SECTION  B:  ICW  PROGRAM  INFORMATION 

This  section  is  to  be  completed  for  a  proposed  development,  or  any  time  a  DITIS 
database  queiy  is  initiated.  The  section  consists  of  eight  data  elements  organized  into  four 
blocks,  and  is  used  as  the  basis  of  the  DITIS  database  search  for  comparable  products. 
The  data  elements  are  the  following: 

5.  ICW  Program  Kev  Words/Conceots.  A  list  of  up  to  10  key  words  or 
concepts  separated  by  commas  that  describes  the  general  training  area  supported  by  the 
ICW  program  (e.g.,  aircraft,  radar,  maintenance,  troubleshooting,  fault  isolation,  repair). 
These  terms  are  the  key  concepts  used  to  search  the  database  for  con^arable  products. 

6a.  Target  Audience.  A  general  description  of  the  intended  trainee  population 
who  will  use  the  ICW  program  (e.g.,  all  aircraft  maintenance  personnel;  advanced  sonar 
technicians;  E-9  load  masters). 

6b.  Specialty  Code(s).  The  specific  specialty  codes  (i.e..  Navy  =  NEC, 
Army/Marine  Corps  =  MOS,  Air  Force  =  AFSC)  of  the  target  audience  for  which  the  ICW 
program  was  designed  (e.g.,  30SX4).  If  the  Id^  program  is  not  targeted  at  a  specific 
occupatitmal  specialty  or  group,  enter  N/A  for  "not  applicable."  This  item  will  be  included 
in  the  Key  concepts  used  to  search  the  database  for  conq)arable  products. 

6c.  Specialty  Ctode  Utlelsy  The  corresponding  titles  of  the  occupatitmal  specialty 
code(s)  listed  in  Item  6b  (e.g..  Electronic  Computer  &  Switching  Systems  Specialist). 
These  terms  will  be  included  in  the  key  concepts  used  to  search  the  database  for  conq)arable 
products. 

6d.  Skill  Level(s).  For  each  of  the  specialty  codes  listed  in  Item  6b,  the  target 
skill  level(s)  to  which  the  ICW  program  was  written.  If  the  program  is  targeted  at  more 
than  one  skill  level,  this  element  lists  the  appropriate  ones,  separated  by  commas  (e.g., 
3,5,7).  If  the  program  is  appropriate  for  all  skill  levels  within  a  specialty  code,  the  word 
"all”  is  entered.  This  item  will  be  included  in  the  key  concepts  used  to  search  the  database 
fOT  conq)azable  products. 

7a.  Operational  Equipment  Designator.  The  short  title  of  the  DoD  designator  of 
the  operational  equipment  supported  by  the  ICW  program  (e.g.,  F-14A;  AN/AH(>64) 
and/or  the  primary  associated  support  equipment  (e.g.,  oscilloscope)  covered  by  the 
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program.  If  the  ICW  program  does  not  deal  with  a  piece  of  equipment,  N/A  is  entered. 
These  terms  will  be  included  in  the  key  concepts  used  to  search  the  database  for  comparable 
products. 

7b.  Onerational  Equipment  Nomenclature.  The  complete  nomenclature  of  the 
DoD  designator  of  the  operational  equipment  supported  by  the  ICW  program  (e.g.,  F-14 
Fighter  Aircraft;  AN/ANQ-64  Radar  Fire-Fighter  Close  Support),  and/or  the  primary 
associated  non-generic  support  equipment  covered  by  the  program.  If  the  ICW  program 
does  not  deal  with  a  piece  of  equipment,  N/A  is  entered.  These  terms  will  be  included  in 
the  key  concepts  us.  J  to  search  the  database  for  comparable  products. 

8a.  Associated  Course  Title(s).  The  Service/agency-assigned  title(s)  of  the 
training  course(s)  that  the  ICW  program  supports  (e.g.,  AT&T  3B15  Computer 
Maintenance).  If  the  ICW  program  does  not  support  a  specific  course,  N/A  is  entered. 

8b.  Associated  Course  Identification  Numberfs^.  The  Service/agency-assigned 
course  identification  number  of  the  training  course(s)  that  the  ICW  program  supports  (e.g., 
ES-370).  If  the  ICW  program  is  used  to  support  on-the-job,  OJT  is  entered. 

SECTION  C:  ICW  PROGRAM  DESCRIPTION 

This  section  is  to  be  completed  within  30  days  following  (Component-approval  to 
develop  or  fund  the  ICW  program  procurement.  The  section  consists  of  12  data  elements 
organized  into  the  following  five  blocks: 

9a.  ICW  Program  Title.  The  Service/agency-approved  name  of  the  ICW 
program. 

9b.  ICW  Program  Identification  Number.  The  Service/agency-approved 
identification  number  of  the  ICW  program. 

9c.  ICW  Program  Version.  The  version  number  and/or  date  of  the  latest  update 
of  the  ICW  program. 

9d.  ICW  Program  Summary.  A  brief  narrative  description  (maximum  100 
words)  of  the  instructional  contents  of  the  ICW  program. 

10.  Estimated  Total  Hours  of  Instruction.  The  projected  average  contact  hours 
necessary  for  a  trainee  to  complete  the  KW  program.  Entry  format  is  hours:minutes  (e.g., 
a  course  that  averages  four  hours  and  IS  minutes  to  complete  is  entered  as  b  IS). 


lla.  Number  of  Courseware  Units.  The  total  number  of  discrete  units  of 
courseware  (i.e.,  lessons  or  modules)  contained  in  the  ICW  program  that  can  be  taught, 
measured,  and  evaluated  as  a  single  unit. 

llb.  Courseware  Unit  Numbers.  The  corresponding  identification  number  for 
each  courseware  unit  in  the  ICW  program.  If  the  ICW  program  contains  only  one  unit, 
N/A  is  entered. 

llc.  Courseware  Unit  Titles.  The  full  title  for  each  courseware  unit  contained 
within  the  ICW  program.  If  the  courseware  units  do  not  have  descriptive  titles,  a  short 
description  of  the  contents  of  the  unit  is  entered  (e.g..  Rules  of  the  Road;  Oscilloscope 
Use.)  If  the  ICW  program  contains  only  one  unit,  N/A  is  entered. 

12a.  Development  of  Acquisition  Method.  Code  to  denote  the  method  by  which 
the  ICW  program  has  been  acquired  or  developed: 

J  -  Joint  development  or  acquisititMi  with  another  Service/agency 

E  -  Development  or  acquisition  based  on  an  existing  program. 

I  >  In-house  design  and  development  (with  or  without  contractor  support) 

C  -  Commercially  available  off-the-shelf  program 

O  -  Other  (specify) 

12b.  DmS  Record  Number  of  Shared  Program.  The  DITIS  record  number  of  the 
ICW  program  of  the  other  Service/agency  if  the  current  program  is  shared  with  another 
Service  or  agency,  or  if  it  is  based  on  ICW  program  materials  received  from  another 
Service  or  agency  (i.e.,  if  the  answer  to  Item  12a  is  "J"  or  "E").  If  this  item  is  not 
applicable  to  the  current  ICW  program,  N/A  is  entered. 

12c.  Use  of  Shared  Program.  Code  to  denote  the  extent  to  which  the  materials  of 
the  shared  program  are  used  in  the  current  ICW  program.  (If  this  item  is  not  applicable  to 
the  current  program,  N/A  is  entered). 

W  -  Shared  program  used  without  modification 

M  -  Minor  changes  made  to  shared  program  (e.g.,  title  change,  additional 
credits) 

C  -  Ck>ntent  changes  made  to  shared  program  (e.g.,  video  reshot,  additions  or 
deletions  made  to  instructitmal  content) 

F  -  Format  changes  only  made  to  shared  program  (e.g.,  different  presentation 
medium  used) 

I  -  Shared  program  materials  only  used  as  inputs  to  the  development  of  the 
current  program. 


13a.  ICW  Program  Materials.  A  list  of  all  training  materials  used  to  suppon  the 
objectives  of  the  ICW  program.  Include  all  plans;  control  documents;  discs,  tapes,  books, 
job  performance  aids,  and  other  support  materials;  and  instructor  guides  and  other  user 
documentation  (e.g.,  1  compact  disc,  2  floppy  discs,  instructor  guide,  trainee  workbook). 

13b.  Deliver  medium.  Code  to  denote  the  primary  type  of  technology  used  by  the 
OCW  program  to  present  information. 

IVD  -  Interactive  Videodisc 
IDD  -  Interactive  Digital  Disc 
DVI  •  Digital  Video  Interactive 

CBI  -  Computer-Based  Instruction  (stand-alone  con^uter) 

CDI  -  (Compact  Disc  -  Interactive 
IVT  -  Interactive  Videotape 
FIT  -  Part  Task  Trainer 
OTH  -  Other  (specify) 

13c.  DoD  Rights  to  ICW  Program.  (Tode  that  denotes  the  type  of  rights  (per  the 
Federal  Acquisition  Regulation)  that  are  owned  by  tire  Department  of  Defense  for  the  KTW 
program: 

U  -  Unlimited 
L- Limited 
O  -  Other  (specify) 

SECTION  D;  SOFTWARE  DESCRIPTION 

This  section  is  to  be  completed  within  30  days  following  the  completion  of  KTW  program 
development  or  acquisition.  The  secticm  consists  of  seven  data  elements  organized  into  tire 
following  two  blocks: 

14a.  Authoring  System  Product  Name:  The  official  product  name  or  trademark  of 
the  authoring  system,  assembly  language,  or  higher  order  language  (HOL)  used  to  develq> 
the  KTW  program  courseware  (e.g..  Instructional  Support  System  GSS)). 

14b.  Authoring  System  Version:  The  version  number  and/or  date  of  the  authoring 
system  assembly  language,  or  higher  order  language  (HOL)  compiler  used  to  develop  the 
ICW  program  courseware  (e.g..  Version  2.1,  December  1989).  If  the  courseware  was 
develqted  using  a  HOL,  the  compiler  version  number  is  given. 


14c.  Authoring  System  Vendor:  The  full  name  and  acronym  (if  appropriate)  of  the 
commercial,  academic,  or  Government  developer  of  the  ICW  authoring  system,  assembly 
language,  or  higher  order  language  used  to  develop  the  IC?W  program  courseware. 

14d.  DoD  Rights  to  Developmental  Authoring  System:  (Tode  that  denotes  the  type 
of  rights  (per  the  Federal  Acquisition  Regulation)  that  are  owned  by  the  Department  of 
Defense  to  the  developmental  portion  of  the  authoring  system  used  to  develop  the  ICW 
program. 

U  -  Unlimited 
L- Limited 
N  -  None 
O  -  Other  (specify) 

15a.  Operating  System  Product  NameA^ersion:  The  official  product  name  or 
trademark,  including  vendor  and  version,  of  the  computer  operating  system  software  used 
by  the  ICW  program  (e.g.,  Microsoft  DOS  4.0). 

ISb.  Operating  System  Software  Drivers  Required:  A  list  of  any  special  software 
drivers  that  are  required  to  run  the  ICW  program  but  are  not  included  as  part  of  the  training 
materials  (e.g.,  mouse  driver,  ANSI.SYS,  CD-ROM  extensions).  If  no  additional 
software  drivers  are  required,  N/A  is  entered. 

16.  DoD  Portability  Standards  Version:  The  version  number  of  the  portability 
standards  in  MIL-H-1379D  used  in  the  development  of  the  ICW  courseware.  If  the 
courseware  was  developed  before  the  initial  issuance  of  MIL-H-1379D,  N/A  is  entered 

SECTION  E:  HARDWARE  DESCRIPTION 

This  section  is  to  be  completed  within  30  days  following  completion  of  ICW 
program  development  or  acquisition.  The  section  consists  of  eight  data  elements  organized 
into  the  following  five  blocks: 

17.  Hardware  Required:  A  list  of  the  official  product  names  or  trademarks  that 
uniquely  identify  each  of  the  hardware  comptments  and  peripherals  required  to  run  the  IC^ 
program  (e.g.,  XY  Model  201  videodisc  player;  RPQ  Model  6012  CD-ROM  interface 
card). 

18a.  Minimum  Free  System  Memory  (RAMI  Required:  The  minimum  amniint  nf 
unused  meiixny  (RAM)  that  must  be  available  on  die  system  to  run  the  ICW  program  (e.g., 
425K). 


18b.  CPU  Tvne:  Type  of  CPU  for  which  the  ICW  program  was  designed  (e.g., 
8086,  8286,  68000). 

18c.  Minimum  Hard  Disk  Space  Required:  If  the  ICW  program  requires  the  use  of 
a  hard  disk  drive,  the  minimum  storage  space  that  must  be  available  on  the  hard  disk  drive 
to  run  the  ICW  program  (e.g.,  2.8  MB). 

19a.  Floppy  Disk  Type:  If  the  ICW  program  requires  the  use  of  floppy  disks,  the 
physical  size  and  capacity  of  the  floppy  disks  for  which  the  ICW  program  was  designed 
(e.g.,  3.5  inch,  720K;  5.25  inch,  360K).  If  the  KTW  program  does  not  require  the  use  of 
floppy  disks,  N/A  is  entered. 

19b.  Number  of  Floppy  Disk  Drives  Required:  If  the  ICW  program  requires  the 
use  of  floppy  disks,  the  number  of  floppy  disk  drives  necessary  to  run  the  program  (e.g., 
2).  If  the  ICTW  program  does  not  require  the  use  of  floppy  disks,  N/A  is  entered. 

20.  Graphics  Adapter  Type  Required:  The  type  of  graphics  adapter  board  that 
must  be  installed  in  the  system  to  run  the  ICW  program  (e.g.,  VGA). 

21.  Input  Devicefsl:  A  list  of  all  input  devices  that  the  ICW  program  was 
designed  to  use  (e.g.,  keyboard,  mouse). 

SECTION  F:  MANAGEMENT  INFORMATION 

This  section  is  to  be  completed  within  30  days  following  completion  of  ICW 
program  development  or  acquisition.  The  section  consists  of  ten  data  elements  organized 
into  the  following  four  blocks: 

22a.  Life  Cycle  Management  Organization  Name.  The  full  name  of  the  activity 
responsible  for  the  life  cycle  management  of  the  KTW  program,  as  designated  by  the 
Component  (e.g..  Chief  of  Naval  Education  and  Training;  USA  Training  and  Doctrine 
Command;  USAF  Air  Training  (Command). 

22b.  1  .ife  Cycle  Management  Office  Symbol.  The  full  office  symbol  of  the  activity 
responsible  for  the  life  cycle  management  of  the  ICW  program,  as  designated  by  the 
Component  (e.g.,  CNET,  Program  Management  Support  Activity,  Code  0474;  HQ 
TRADOC  Attn:  ATTG-Cl;  HQ  ATC/TTOR). 

22c.  Life  Cycle  Management  POint-Qf-Contact  (POQ  Nanae.  The  nanne  and  tide  of 
die  person  designated  by  the  dbnqionent  to  be  the  life  cycle  manager  for  the  ICW  program. 


22d.  li 


(1)  Commercial.  The  commercial  telephone  number,  including  area  code, 
of  the  life  cycle  manager  for  the  ICW  program  (e.g.,  (407)  555-1234). 

(2)  AUTOVON.  The  AUTOVON  telephone  number  of  the  life  cycle 
manager  for  die  ICW  program. 

23a.  Security  Clearance  Required.  Code  that  denotes  the  clearance  level  required 
for  an  individual  to  view  or  discuss  the  ICW  program. 

U  -  Unclassified 
C  -  Confidendal 
S -  Secret 
O  -  Other  (specify) 

23b.  Restrictions  to  Distribution.  CTode  that  denotes  the  release  status  of  the  ICW 
program,  based  on  the  content  of  the  program  materials. 

LR  -  Legal  restrictions  to  public  distribution 

NR  -  No  legal  restriction  to  puUic  distributitm 

CP  -  Qeared  for  public  exhibition  but  not  distribution 

CG  -  Qeared  for  Government  distribution  only 

Q)  -  Qeared  for  DoD  distribution  only 

RD  -  Restrictions  to  DoD  distribution 

RF  -  NOFORN  (i.e.,  not  available  to  foreign  nationals) 

or  -  Other  (specify) 

23c.  Adaptability  to  Civilian  Training.  Code  to  denote  the  ease  with  which  the 
KTW  program  can  be  adapted  for  use  in  training  in  the  civilian  sector. 

W  -  Usable  without  modification 

M  -  Requires  minor  changes  (e.g.,  tide  change,  addititmal  credits) 

C  -  Requires  content  changes  (e.g.,  video  reshot,  additions  or  deletions  to 
instructional  content) 

I-  Requires  major  changes  or  can  (Hily  be  used  as  inputs  to  development 

of  civilian  training 

N  -  Not  tq)plicable  to  civilian  training 

O-  Other  (specify) 

23d.  Military  Articles  and  Service.s  Listing  (MASLi  Number.  If  the  ICW  program 
is  availaUe  for  the  Military  Assistance  Program,  enter  die  Military  Articles  and  Services 
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Listing  (MASL)  number  assigned  by  the  Compcment.  If  the  ICW  program  is  not  available 
for  the  Military  Assistance  Program,  N/A  is  entered. 

24a.  Courseware  Developer  Name.  The  full  name  and  acronym  (if  appixqniate)  of 
the  contractor  or  Government  agency  responsible  for  developing  the  ICW  program 
courseware  (e.g..  Chief  of  Naval  Education  and  Training  (CNET);  USA  Training  and 
Doctrine  Command  (TRADCXI);  USAF  Air  Training  Command  (ATC)).  If  the  ICIW 
program  is  a  joint  in-house/contractor  development  effort,  the  name  of  the  contractor  is 
entned. 

24b.  Year  Developed  or  Last  Undated.  The  full  calendar  year  that  the  ICW 
program  was  developed  or,  if  the  program  has  since  been  updated,  the  full  calendar  of  the 
latest  revision.  This  data  element  applies  only  if  this  is  the  record  of  a  currently  fielded 
program  that  has  not  previously  been  entered  into  the  DITIS  database;  otherwise,  N/A  is 
entered. 

25.  Defense  Automated  Visual  Information  System  (DAVIS)  Production 
Identification  Numberfsl  (PINs):  The  PIN(s)  assigned  to  the  ICW  program  by  DAVIS,  if 
the  I(ZW  program  contains  video.  If  the  ICW  program  does  not  contain  video,  N/A  is 
entered. 


